Data Engineer
Role details
Job location
Tech stack
Job description
- Design, develop, and maintain new ETL, data extractions and ingestions.
- Define and build scalable data pipelines from complex data sources.
- Collaborate with data team members to define data quality rules., * Play an instrumental role in the design, development, and maintenance of new ETL, data extractions and ingestions, data quality, ensuring FAIR principles are achieved.
- Work with large and complex datasets, within the platform and make them available to different stakeholders.
- Define and build scalable data pipelines to integrate and model datasets from complex data sources.
- Ensure data quality best practices, defining and implementing automated testing of data pipelines and orchestration.
- Collaborate with data team members to define data quality rules and KPIs for monitoring and exception alerts.
- Diagnose and triage infrastructure problems and outages related to the data and analytics platform.
- Learn quickly about new technologies as the project grows and will serve other business units; learn about different technologies.
- Closely collaborate with the cloud engineering team to drive automation and observability as a key success factor.
Requirements
Schneider Electric in Bellprat, Cataluña, seeks a Data Engineer to drive the modernization of data platforms. The role involves designing scalable data pipelines, ensuring data quality, and collaborating with teams to support data needs. The ideal candidate will have a Bachelor's in Computer Science, a minimum of 2 years' experience in data engineering, and skills in Python, Git, and ETL pipelines. Schneider Electric offers a hybrid work plan, flexible schedules, and various well-being benefits., * A minimum of 2 years' experience in a data engineering role.
-
Hands-on experience building on PySpark.
-
Experience in developing and operating workflow orchestration., Data processing concepts like ETL pipelines Python Git Data modeling Agile knowledge Fluent in English, Bachelor's degree in Computer Science or related field, * A bachelor's degree in Computer Science, Engineering, Mathematics, Economics, or a related field
-
A minimum of 2 years' experience in a data engineering role
-
Familiarity with data processing concepts like ETL pipelines
-
Experience with Python and Git
-
Knowledge of good practices for Python development (project structure, testing, formatting, deployment)
-
Hands-on experience building on PySpark
-
Experience with S3 for object storage and data lakes
-
Experience in data modeling
-
Experience in developing and operating workflow orchestration
-
Understanding of data partitioning and file formats like Iceberg and Delta
-
Understanding of data warehousing concepts and querying languages like SQL
-
Agile knowledge
-
Fluent in English
Desirable Skills/Experience
- Experience with EMR, Databricks and AWS Glue
- Familiarity with the AWS console and basic command-line tools (AWS CLI)
- Basic understanding of AWS serverless services like Lambda, Step Functions, AWS Glue and Redshift
- Experience with CI/CD pipelines for automating infrastructure and code deployment
- AWS certification: Solution Architect, SysOps Administrator, Developer, DevOps Engineer
- Experience with streaming data services (Kafka, Kinesis, MKS, DMS)
- Experience with developing containerized solutions (Docker)
Benefits & conditions
- With our flexible schedule, you can adjust your work hours to accommodate personal needs and responsibilities.
- Hybrid work plan for remote work from home.
- Holy Pack: additional vacation days for recharge when needed.
- Floating Holidays: exchange holidays for other days that better fit plans.
- Sabbatical Pack: up to 2 months of additional unpaid leave.
- Global Family Leave Policy with flexible paid conditions for parenting, bereavement, or caring for a loved one.
We take care of you:
- Wellbeing platform access for you and up to 5 people (Wellwo) with wellness content and services.
- Agreement with Wellhub for access to a network of gyms and wellness centers.
- Medical service at workplace for medical needs.
We empower you:
- Career Hub, an AI-driven professional development platform to connect with opportunities, projects, and mentors.
- Stock ownership program opportunities.
- Recognition program to acknowledge achievements and redeem points for gift cards.
- Life insurance for protection.
- Flexible Remuneration Plan with various options (health insurance, vouchers, training, etc.).
- Club Schneider with discounts at stores, restaurants, travel agencies, and other services.
- Volunteer programs to contribute to the community and environment.
Impact and culture