Senior Data Engineer

Trimble
Municipality of Madrid, Spain
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Municipality of Madrid, Spain

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Bash
Big Data
Cloud Computing
Cloud Engineering
Software Quality
Databases
Data as a Services
Information Engineering
Data Governance
ETL
Data Visualization
Data Warehousing
Cursor (Graphical User Interface Elements)
DevOps
Disaster Recovery
Amazon DynamoDB
Python
PostgreSQL
Machine Learning
Power BI
Cloud Services
Azure
SQL Databases
System Availability
Snowflake
Spark
Infrastructure as Code (IaC)
GIT
Cloudformation
Containerization
PySpark
Kubernetes
Amazon Web Services (AWS)
Terraform
Azure
Data Pipelines
Azure
Docker
Redshift
Databricks

Job description

We are looking for a highly skilled Senior Data Engineer for our Data and Cloud Engineering team with expertise in AWS and Azure. The ideal candidate will have a strong technical background in designing, building, developing, and implementing data pipelines and cloud solutions along with great technical guidance and communication skills. Your daily tasks...

  • Design and implement robust, scalable, and secure cloud-based data pipelines and architectures in AWS (later maybe migrating to MS Azure).

  • Ensure best practices in code quality, architecture, and design.

  • Design and implement secure, scalable, and high-performance cloud infrastructure.

  • Manage cloud resources, optimize costs, ensure high availability and disaster recovery.

  • Automate infrastructure provisioning and deployment processes using Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, and ARM templates.

  • Collaborate with cross-functional teams to understand data needs and deliver comprehensive cloud solutions.

  • Oversee cloud infrastructure management, including monitoring, maintenance, and scaling of cloud resources.

  • Ensure compliance with industry standards and regulatory requirements.

  • Implement data governance policies and practices and ensure high data quality, integrity, and security across all cloud platforms.

  • Identify and implement process improvements to enhance efficiency, quality, and scalability of data engineering and cloud operations.

  • Stay current with emerging technologies and industry trends to drive innovation. Utilize AI to increase our efficiency. Our tech-stack...

  • Infrastructure: Glue, Lambda, Step Function, Batch, ECS, Quicksight, Machine Learning, Sagemaker, Dagster

  • DevOps: Cloudformation, Terraform, Git, CodeBuild

  • Database: Redshift, PostgreSQL, DynamoDB, Athena (Trino), Snowflake, Databricks

  • Language: Bash, Python (PySpark, Pydantic, PyArrow), SQL

Requirements

  • Min. 5 years of proven experience as a Data Engineer with proven track record of delivering production-grade data pipelines.
  • Hands-on experience with AWS cloud platform and its data services (, AWS Redshift, AWS Glue, AWS S3, Azure Data Lake, Azure Synapse, Snowflake, Databricks).
  • Strong understanding of ETL processes, data warehousing, and big data technologies.
  • Proficiency in SQL and Python, comfortable with Spark jobs.
  • Experience with infrastructure as code (IaC) tools such as Terraform, CloudFormation, or ARM templates.
  • Knowledge of containerization and orchestration (, Docker, Kubernetes).
  • Understanding of cloud cost management and optimization strategies.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Strong problem-solving and analytical skills.
  • Familiarity with data visualization tools (, Power BI, QuickSight) is a plus.
  • Openness to use AI, in our case Cursor, as your daily tool.

About the company

Transporeon is a SaaS company founded in 2000 in Ulm, Germany. The company provides logistics solutions across several areas, including: * Buying & selling of logistics services * Organizing shipment execution * Organizing dock, yard, truck, and driver schedules * Invoice auditing for logistics services It has grown significantly over the years, reaching €150m in revenue before being acquired by Trimble for $2 billion USD in 2022. Transporeon has one of the largest networks of shippers and carriers in Europe, with approximately 1,400 employees, On-site in Ulm, Germany or Tallinn, Estonia or remote role in following countries: Estonia, Latvia, Lithuania, Poland, Slovakia, Hungary, Romania, Portugal, Spain, Italy, Croatia. We are not offering freelancing contract, only local employment contract., At Trimble, our core values of Belong, Grow, and Innovate aren't just words-they're the foundation of our culture. We foster an environment where you are seen, heard, and valued (Belong); where you have an opportunity to build a career and drive our collective growth (Grow); and where your innovative ideas shape the future (Innovate). We believe in empowering local teams to create impactful strategies, ensuring our global vision resonates with every individual. Become part of a team where your contributions truly matter. Trimble's Privacy Policy If you need assistance or would like to request an accommodation in connection with the application process, please contact om.

Apply for this position