Lead AWS Data Engineer

Q1 Technologies, Inc.
Owings Mills, MD, United States
4 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Agile Methodology Airflow Software Code Optimization Databases Data Integration Extract Transform Load (ETL) Data Mart Data Warehousing IBM DB2 Software Debugging Python (Programming Language) PostgreSQL
+10 more
Operational Data Store SQL Databases Data Streaming Enterprise Data Management Snowflake Data Strategy Data Lakes Pyspark AWS Data Analytics Data Pipelines

Job description

leads the design, development, and maintenance of data integration solutions using Python, AWS Data Services, DBT ensuring data pipeline & data quality Collaborate with business stakeholders and architects to define the enterprise data strategy, data models, and migration Roadmap Translate complex technical constraints into business insights and manage expectations across cross-functional teams Develop, modify, configure & debug existing data pipeline as per the business requirement. Troubleshoot and resolve technical issues. Debug, tune and optimize code for optimal performance Manage the new requirements, Review the existing jobs, Perform gap analysis & Fixing performance issues, etc. Guide, coach, and upskill junior and mid-level data engineers on best practices, coding standards, and modern data patterns Document all data flow & mappings, sessions and workflows Ticket handling and problem ticket analysis skills in Agile /POD approach

https://job.goodword.io/JobLanding/JobId=35d81a36-bdc8-472d-affb-02b28066b7db?trafficsourceid=0 external

Requirements

  • 12 years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform),

SQL and PySpark

  • Very Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.
  • Experience in creating data pipelines and orchestrating using DBT & Apache Airflow
  • Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses,

Data Lake and Data Marts.

Must Have Technical/Functional Skills-

12 years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark Very Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement. Experience in creating data pipelines and orchestrating using DBT & Apache Airflow Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts. Experiencing in fixing performance issues / parallelism, Data model exposure is a must. Good to have: Experience with cloud ETL and ELT in one of the tools like Glue/EMR or any other ELT tool Experience in using Snowflake, DB2, Postgres and other database technologies is plus. Excellent communication skills to liaise with Business & IT stakeholders. Expertise in planning execution of a project and efforts estimation. Exposure to working in Agile ways of working

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…