Data Engineer / ETL Engineer - AGS 0527 SS#
Role details
Job location
Tech stack
Job description
We are seeking a skilled Data Engineer / ETL Engineer to design and build robust data pipelines supporting large-scale, data-intensive environments. This role focuses on ingesting, transforming, and managing diverse datasets including telemetry, sensor feeds, maintenance systems, and logistics data.
The ideal candidate will play a critical role in ensuring data quality, accessibility, and scalability for downstream analytics and operational decision-making.
Key Responsibilities
- Design and develop data ingestion pipelines for multiple data sources, including:
- Telemetry data
- Sensor feeds
- Maintenance and operational systems
- Logistics and supply chain data
- Build and maintain ETL/ELT workflows for structured and unstructured data
- Normalize, cleanse, and validate large datasets to ensure data integrity
- Integrate data from various APIs and external systems
- Optimize data pipelines for performance, scalability, and reliability
- Work with data lakes and distributed data platforms
- Collaborate with data scientists, analysts, and engineering teams
- Implement best practices for data governance and security
Requirements
Do you have experience in Systems integration?, * Strong experience with Apache Spark for large-scale data processing
- Hands-on experience with Apache Kafka or similar streaming platforms
- Proficiency in SQL and NoSQL databases
- Experience designing and working with data lakes
- Experience with API integration and data ingestion frameworks
- Strong understanding of ETL/ELT processes and data modelling
- Ability to work with both structured and unstructured data
Preferred / Nice-to-Have
- Experience with real-time data processing and streaming architectures
- Exposure to sensor or telemetry data environments
- Knowledge of cloud-based data platforms (AWS, Azure, GCP)
- Familiarity with data governance, security, and compliance practices
- Experience in aerospace, defence, or other regulated industries
Work Environment
- Collaborative, cross-functional data and engineering teams
- High-impact, data-driven programs
- Opportunity to work with modern data architectures and large-scale systems
Benefits & conditions
From $40 an hour - Full-time, Contract