data engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+15 more
Job description
We are seeking a Data Engineer to support the development and optimization of a Databricks-based enterprise analytics platform.
This role will focus on building scalable data pipelines, integrating data from multiple enterprise sources, and delivering curated datasets that support reporting, customer analytics, and AI initiatives.
The ideal candidate is a hands-on engineer with strong Databricks, SQL, Python, PySpark, and AWS experience who can contribute across architecture, development, and operational support activities.
Key Responsibilities
Β· Design and develop scalable data ingestion and transformation pipelines.
Β· Build and maintain curated datasets for analytics and reporting.
Β· Integrate structured and unstructured data from enterprise systems.
Β· Optimize Databricks workloads, data models, and query performance.
Β· Implement data quality, validation, and monitoring processes.
Β· Support analytics and AI initiatives through reliable data engineering practices.
Β· Collaborate with analysts, architects, and business stakeholders.
Requirements
Skills: Data Engineer (Databricks/Aws), Medallion, Delta Lake, Β· 8+ years of Data Engineering experience.
Β· Strong Databricks experience, including Delta Lake, Workflows, and Databricks SQL.
Β· Advanced SQL, Python, and PySpark skills.
Β· Experience building enterprise-scale ETL/ELT solutions.
Β· AWS cloud platform experience.
Β· Strong understanding of data modeling and lakehouse architectures.
Β· Experience with GitHub, Jira, and Agile delivery practices.
Preferred Skills
Β· Experience with vector databases, graph databases, or NoSQL technologies.
Β· Exposure to AI/ML solutions, RAG architectures, or LLM-related data platforms.
Β· Experience with Terraform, Jenkins, Splunk, or Dynatrace.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦