Lead Data Engineer (IoT)

Atlas Copco
Antwerp, Belgium
27 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Antwerp, Belgium

Tech stack

Core Foundation
ETL
Dimensional Modeling
Hive
Python
SQL Databases
Data Streaming
Data Storage Technologies
Snowflake
Spark
PySpark
Kafka
Data Management
Data Pipelines
Devsecops
Databricks

Job description

You'll be a key player in designing, building and maintaining IoT fleet monitoring and alerting services that are a core foundation for our ISO27001-certified state-of-the-art SMARTLINK IoT platform , with already more than 300.000 connected devices and 100.000 users around the world. This involves building scalable data pipelines to provide insights and enable data-driven decision-making to optimize the overall connectivity of our fleet of sensors and IoT gateways.

To achieve this, you'll work with a range of technologies to create performant, scalable and reliable solutions . Throughout this process, you'll collaborate closely with our embedded hardware and software engineers, our solution architects & DevSecOps team. You'll be sharing your expertise and contributing to the ongoing evolution of our fleet management platform, so you'll be expected to keep up-to-date with the latest trends and industry best practices., At Atlas Copco Group, our slogan for various positions is "hire for attitude & train for skill". We train you for these positions through on-the-job-training. Do you only partly meet the profile as outlined below? No problem! We still encourage you to apply and take this opportunity. Who knows, on-the-job-training may be available for you for this position.

  • SQL & Python : Strong skills for data querying, transformations, and pipeline development.
  • Data Pipelines : Hands-on experience building scalable batch and streaming pipelines using frameworks such as Apache Spark (PySpark, Spark SQL, Structured Streaming) for large-scale jobs and near-real-time flows.
  • Data Platforms : Familiarity with modern data-lake and lakehouse platforms (e.g., Databricks) and cloud-native data storage/processing for ingestion, storage, transformation, and analytics.
  • Data Modeling & Warehousing : Solid understanding of dimensional modeling, star/snowflake schemas, and schema design to ensure data is organized and optimized for analytics and BI.
  • Streaming & Messaging : Experience or readiness to integrate systems such as Apache Kafka for real-time ingestion or event-driven architectures.
  • Orchestration & Workflow Management : Awareness of tools and practices for robust, maintainable ETL/ELT flows (batch or streaming), including dependency handling, scheduling, and monitoring.

Requirements

Do you have experience in Spark?, We're searching for a talented Lead Data Engineer to join our SMARTLINK IoT Fleet Management team. If you're passionate about building robust and scalable data-driven solutions and love the challenge of working with cutting-edge technology, this role is perfect for you!

Benefits & conditions

You will benefit from a comprehensive onboarding program, including guidance by a personal godmother/godfather. As part of the Atlas Copco Group, you will also have access to global career opportunities. We offer a competitive compensation and benefits package, including health insurance, paid leave and retirement benefits.

About the company

At Atlas Copco Group you will join an international and diverse environment with specialists from different disciplines. Our culture is rooted in Swedish values, which includes a family feeling, respect and diversity. We invest in our employees' development and well-being, and we provide a flexible work-life balance. With our inclusive and caring environment, you get the support and inspiration you need to grow.

Apply for this position