Data Engineer
Role details
Job location
Tech stack
Job description
Play an instrumental role in the design, development, and maintenance of new ETL, data extractions and ingestions, data quality… ensuring FAIR principles are achieved.
- Work with large and complex datasets, within the platform and make them available to different stakeholders.
- Define and build scalable data pipelines to integrate and model datasets from complex data sources.
- Ensure the quality best practices, defining and implementing automated testing of data pipelines and orchestration.
- Collaborate with data team members to define data quality rules and KPIs for monitoring and exception alerts.
- Diagnose and triage infrastructure problems and outages related to the data & analytics platform.
- Learn fast about new technologies, project is growing fast and will be soon serving other BU, you will need to learn about different technologies.
- Closely collaborate with our cloud engineering team to drive automation and observability as a key success manner.
Requirements
A bachelor's degree in: Computer Science, Engineering, Mathematics, Economics, or a related field
- A minimum of 2 years' experience in data engineering role
- Familiarity with data processing concepts like ETL/ETL pipelines
- Experience with Python and Git.
- Knowledge of good practices for Python development (project structure, testing, formatting, deploy, etc.)
- Hands on experience building on Pyspark.
- Experience with S3 for object storage and data lakes.
- Experience in data modelling.
- Experience in developing and operating workflow orchestration.
- Understanding of data partitioning and file formats like Iceberg and Delta.
- Understanding of data warehousing concepts and querying languages like SQL.
- Agile knowledge.
- Fluent in English.
Desirable Skills/Experience:
Experience with EMR, Databricks and AWS Glue.
- Familiarity with the AWS console and basic command-line tools (AWS CLI)
- Basic understanding of AWS serverless services like Lambda, Step functions, AWS Glue and Redshift.
- Experience with CI/CD pipelines for automating infrastructure and code deployment.
- AWS certification: Solution architect, SysOps Administrator, Developer, DevOps Engineer.
- Experience with streaming data services (Kafka, Kinesis, MKS, DMS)
- Experience with developing containerized solutions (Docker)
Benefits & conditions
With our flexible schedule, you'll have the freedom to adjust your work hours to accommodate your personal needs and responsibilities.
We know how great it is to work from home. With our hybrid work plan, you can enjoy working from the comfort of your home.
Need more time to relax and disconnect? With our Holy Pack, you can purchase additional vacation days to recharge when you need it most.
Celebrate holidays your way! With Floating Holidays, you can exchange holidays for other days that better suit your plans and personal preferences.
Need additional time to explore new experiences or focus on personal projects? With the Sabbatical Pack, you can request up to 2 months of extra leave (unpaid).
We value the importance of family and want to support you in all aspects of your life. Our Global Family Leave Policy provides flexible paid conditions for when you need it most, whether you're about to be a parent, need time to overcome a loss, or to care for a loved one.
We take care of you:
With access to the health and wellness platform Wellwo, you and up to 5 people of your choice can enjoy access to wellness content, nutrition counseling, fitness classes, and more!
From dance classes to booking a hotel spa, we offer an agreement with Wellhub so you can access a network of thousands of gyms and sports centers to keep your body active in the way you like best.
Your well-being is our priority. You will have medical service at your workplace for close attention to any medical needs.
We empower you:
With Career Hub, our AI-driven professional development platform, you can connect with job opportunities, projects, and mentors at Schneider Electric globally.
We offer you the opportunity to be a shareholder of Schneider Electric and share in our achievements with our stock ownership program.
We celebrate everyone's talent and success with our recognition program, through which you can give and receive points for your achievements and redeem them for gift cards at your favorite stores.
You will have life insurance for your protection.
We offer you a Flexible Remuneration Plan in which you can choose from a variety of options, such as health insurance, meal vouchers, childcare vouchers, transportation vouchers, training, and more.
With Club Schneider, you will enjoy special discounts at your favorite stores, restaurants, travel agencies, and other external services.
Participate in company-subsidized volunteer programs to contribute to our community and have a positive impact on your environment. (External) English Company Boiler Plate