Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+19 more
Job description
Experteer Overview In this role you will shape and govern large-scale data architectures to enable data-driven decisions. Youāll lead design and implementation of data warehouses, lakes, and streaming platforms while collaborating with cross-functional teams. Your work will optimize pipelines and ensure data quality, security, and performance. This hybrid role blends hands-on engineering with strategic architecture to deliver scalable data solutions aligned with business goals. Compensation / Benefits * Engage with customers to understand use-cases and needs, advocating for user-centric data solutions * Design, develop, and deliver software and data architecture across full stack * Select technology stacks, integration approaches, and deployment strategies * Create high-level architecture designs outlining components and interfaces * Collaborate with product, design, and architecture teams to align on solutions * Define and implement software and data test strategies and governance * Improve performance and adopt new technologies to boost efficiency * Apply test-driven development, CI/CD practices * Support security practices including data encryption and anonymization * Build user-friendly interfaces for data products * Develop and maintain back-end services and APIs * Evaluate emerging technologies and stay aligned with industry trends Tasks * 5+ years of progressive experience in data engineering or related role with focus on large-scale data systems * Expert proficiency in Python or Scala * Advanced SQL and complex data manipulation * Extensive experience with big data tech (Spark, Hadoop, Kafka, Flink) * Proven experience with cloud platforms (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, Athena, Glue; Data Factory, Databricks, BigQuery, Dataflow) * Strong data warehousing, data modeling (dimensional/relational), and ETL/ELT * Experience with version control systems (Git) * Excellent problem-solving, analytical and communication skills * Bachelorās degree * Knowledge of data governance and security practices Key requirements * HYBRID / 4 days per week in the office
Requirements
Improve performance and adopt new technologies to boost efficiency * Apply test-driven development, CI/CD practices * Support security practices including data encryption and anonymization * Build user-friendly interfaces for data products * Develop and maintain back-end services and APIs * Evaluate emerging technologies and stay aligned with industry trends Tasks * 5+ years of progressive experience in data engineering or related role with focus on large-scale data systems * Expert proficiency in Python or Scala * Advanced SQL and complex data manipulation * Extensive experience with big data tech (Spark, Hadoop, Kafka, Flink) * Proven experience with cloud platforms (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, Athena, Glue; Data Factory, Databricks, BigQuery, Dataflow) * Strong data warehousing, data modeling (dimensional/relational), and ETL/ELT * Experience with version control systems (Git) * Excellent problem-solving, analytical and communication skills * aaaaa aaav_ degree * Knowledge of data governance and security practices Key requirements * HYBRID / 4 days per week in the office
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on us.experteer.comGood distractions
Talks and stories from around this role ā technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developerās Story
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Dev Digest 120 - Apple and peers