Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging Databricks, Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives., * Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.
- Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
- Implement data governance, security, and compliance standards.
- Automate workflows using Python scripting and CI/CD pipelines.
- Troubleshoot and resolve issues in data ingestion, transformation, and storage.
Requirements
Business Intelligence, Python Programming/Scripting Language, DevOps, Database Extract Transform and Load (ETL), Data Management, Cloud Computing, Software Engineering, Scalable System Development, Data Warehousing, Regulatory Compliance, * 8+ years in data engineering or related roles.
- Expert-level Python programming for data processing and automation.
- Hands-on experience with Databricks and Delta Lake.
- Strong knowledge of Azure Data Factory, Data Lake, and Synapse (or equivalent cloud platforms).
- Proficiency in SQL and performance tuning.
- Familiarity with DevOps practices, CI/CD, and infrastructure-as-code tools.
- Experience with data migration and cloud-native architectures.
- Excellent problem-solving and communication skills
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦