Senior Data Engineer (Spark/Scala)

Talan SAS
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Tech stack

Amazon Web Services (AWS)
Automation of Tests
Unit Testing
Big Data
Cloud Storage
Static Program Analysis
Software Quality
Computer Programming
Continuous Integration
Data Validation
ETL
Data Systems
Data Visualization
Relational Databases
Distributed Systems
Hive
Power BI
Fortify (Software)
SONAR (Symantec)
SQL Databases
Data Ingestion
Spark
Data Lake
Databricks

Job description

We are looking for a highly skilled Senior Data Engineer with strong experience in designing, building, and maintaining scalable data solutions. The ideal candidate has a deep understanding of ETL processes, big data technologies, and modern analytics platforms, and is comfortable working in fast-paced, data-driven environments., * Design, develop, and optimize robust ETL pipelines to support data ingestion, transformation, and processing at scale.

  • Build and maintain high-performance data models to support analytics, reporting, and data science initiatives.
  • Work with large-scale distributed systems and data lake architectures (Apache Hive, AWS S3, etc.).
  • Ensure data quality through strong validation practices and automated testing.
  • Collaborate closely with cross-functional teams to deliver secure, clean, and reliable data to downstream consumers.
  • Implement and maintain CI/CD pipelines and align code to static analysis tools such as Sonar or Fortify.
  • Work with BI tools and platforms (Databricks, Power BI, Starburst, etc.) to enable effective data visualization and insights.

Requirements

  • 5+ years of experience in implementing ETL pipelines.
  • 3+ years of experience working with Apache Spark.
  • 3+ years of hands-on experience with Scala programming.
  • 2+ years of experience with BI tools (Databricks, Power BI, Starburst, or similar).
  • Strong expertise in SQL and relational database systems.
  • Experience designing and implementing data models for enterprise use cases.
  • Familiarity with data lakes and cloud-based storage environments (Apache Hive, AWS S3).
  • Strong background in data validation, unit testing, and best practices for code quality.
  • Solid understanding of CI/CD principles and experience delivering high-quality code in production environments.

Apply for this position