Lead Data Engineer

OPEN QUEUE LLC

Atlanta, GA, United States

4 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

2 years minimum

Compensation

$75,000.0 - $100,000.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Airflow Amazon S3 Apache HTTP Server Databases Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL) Data Warehousing Python (Programming Language) Operational Databases Performance Tuning

+6 more

Apache Spark Informatica Cloud Data Lakes Pyspark AWS Data Analytics Virtual Agents

Requirements

We are looking for a Senior AWS Data Engineer to design, develop, optimize, and support enterprise data pipelines and data integration solutions. Required Skills:

5+ years of Data Engineering, ETL, database, and data warehousing experience
Strong hands-on experience with AWS Glue, EMR, S3, Redshift, RDS, Athena, and Airflow/MWAA
Strong PySpark, Apache Spark, and Python experience
Experience with Apache Iceberg and data lake/lakehouse architectures
2+ years of CI/CD experience
Experience designing, monitoring, troubleshooting, and supporting production data pipelines
Strong knowledge of data quality, performance tuning, error handling, and scalability
Experience with Redshift query/performance optimization
IDMC (Informatica Cloud) is a plus
Amazon Kiro / Agentic AI experience is a plus

Important: Candidates must be able to work onsite in Torrance, CA 4 days per week and should be willing to work onsite 5 days if required. For applications and inquiries, contact:hirings@openkyber.com

Benefits & conditions

$144,000-210,000 per year Cargill’s size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. Cargill is a family comp…
15 days ago +