Lead Data Engineer / Airflow Architect - Orchestration & Integration

Artmac Soft LLC

Prosper, TX, United States

20 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

9 years minimum

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Airflow Computer Programming Databases Continuous Integration Directed Acyclic Graph (Directed Graphs) Information Engineering Data Integration Extract Transform Load (ETL) Relational Databases Software Design Patterns Fault Tolerance Python (Programming Language)

+9 more

Software Engineering SQL Databases Data Streaming Data Logging Enterprise Software Applications Database Replication Oracle Ebusiness Software Version Control Data Pipelines

Requirements

9 12 years of experience in Data Engineering, Data Integration, ETL, or related areas.
Strong hands-on expertise with Apache Airflow and enterprise orchestration architecture.
Proven experience designing and implementing complex, enterprise-scale Airflow DAGs.
Experience with Oracle EBS integration and enterprise application data flows.
Experience designing highly scalable, reliable, and fault-tolerant data pipelines.
Experience implementing data quality and validation mechanisms.
Hands-on experience with CI/CD practices and source control.
Experience participating in or leading technical architecture and design reviews.
Strong programming skills in Python.
Strong proficiency in SQL and relational databases.
Strong understanding of ETL/ELT and data integration architecture
Strong understanding of database synchronization, data replication, and data movement patterns.
Strong knowledge of monitoring, observability, logging, alerting, and failure recovery.
Strong understanding of software engineering principles, design patterns, and development standards.
Design and define enterprise Airflow architecture, standards, frameworks, and best practices.
Architect and develop scalable, reusable, and maintainable Airflow DAGs for complex data workflows.
Lead the design of ETL/ELT and data integration architectures across multiple enterprise systems.
Develop robust data pipelines using Python, SQL, and Airflow.
Design and implement integration patterns for Oracle EBS and other enterprise applications.
Design pipelines to support high-volume, scalable, and performance-sensitive workloads.
Establish and improve pipeline observability, including logging, monitoring, metrics, SLA tracking, and operational dashboards.
Implement data quality and validation frameworks to ensure data accuracy, completeness, and consistency.

Qualification: Bachelor’s degree or equivalent combination of education and experience.

About the company

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.