Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
Design, build, and maintain scalable data pipelines using Python, SQL, PySpark, and Microsoft Fabric.
- Integrate with external systems using REST/Graph APIs, managing authentication, pagination, rate limits, and error handling.
- Support and enhance existing pipelines, ensuring high reliability, observability, and performance.
-
Migrate current Python-based or legacy pipelines into Microsoft Fabric (Data Factory, Data Engineering/Notebooks, Lakehouse). Data Analytics & Modeling
- Build and maintain data models, semantic layers, and analytics-ready datasets.
- Develop transformations and calculations needed for BI and reporting.
- Create or support analytical outputs using tools such as Power BI.
-
Implement data quality checks, validation rules, and data governance best practices. Operations & Continuous Improvement
- Troubleshoot pipeline/data issues, identify root causes, and provide long-term solutions.
- Optimize performance, cost, and reliability across all data workflows.
- Collaborate with business, product, analytics, and IT teams to translate requirements into technical solutions.
- Maintain documentation, data lineage, and change management practices.
Requirements
Data Management, SQL (Structured Query Language), Python Programming/Scripting Language, Microsoft Product Family, Scalable System Development, REST (Representational State Transfer), Application Programming Interface (API), Authentication, Pagination, Error Handling
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦