DATA ENGINEER

Develop the Index Geo Mapping application software using tools like python, shell scripting for processing. Use clean data to create tables in AWS Redshift. Connect the
tables to mapbox software, which helps to visualize the clean data in the form of heat maps. Designing and implementation of solutions to ingest, transform and deliver data in AWS for
analytics. Utilizing the AWS EMR for spinning up of spark clusters on demand depending on the volume and format. Handling different data format like JSON, Parquet from vendors and making use of python and pyspark to convert and compress the data for downstream data analysis. Scheduling jobs using Apache Airflow for python and shell scripts for automating the daily tasks in AWS ecosystem. Capturing the real time kinesis events and logs for debugging, analysis in downtime scenarios and creating backups. Creating IAM roles for end users for accessing data across the AWS Ecosystem. Making use of Monitoring tools like Datadog for resource performance valuation. Creating the Data Flow Documents and maintaining the on-call support playbook. Travel to work at DC office 30% of the time if working remotely.

Minimum Requirements: Master’s degree in Computer Engineering or related. Knowledge or experience in SQL, NoSQL, Building API’s, Cloud Data Migration, spark, Spark SQL and HiveSQL; Knowledge or experience in designing data integrations and data quality framework; Knowledge or experience in Data modeling and Data optimization; Able to work at DC office 30% of the time if working remote from home.

Job Location: National Minority Quality Forum INC, 1201 15th Street NW, Suite 340, Washington, DC 20005. Allow remote work from home. Require 30% travel to work at DC
office if remote work from home.

If interested, mail your resume to Job Location: National Minority Quality Forum INC, 1201 15th Street NW, Suite 340, Washington, DC 20005. Attn: Gary Puckrein