Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
- Design, develop, and maintain ETL/ELT pipelines using Databricks (PySpark/Spark SQL) for large-scale data processing
- Build and support business applications, workflows, and automations using Power Apps, Power Automate, and the broader Power Platform
- Write complex, performant SQL queries, stored procedures, and views across relational databases
- Develop reusable Python scripts/modules for data transformation, automation, and integration tasks
- Design and optimize data models and schemas to support analytics and reporting needs
- Integrate Power Platform solutions with backend data sources (Databricks, SQL databases, APIs)
- Collaborate with business stakeholders, analysts, and data scientists to translate requirements into technical solutions
- Ensure data quality, governance, and security best practices across pipelines and applications
- Monitor, troubleshoot, and optimize existing pipelines and applications for performance and reliability
- Document technical designs, data flows, and processes for maintainability
Requirements
We are seeking a Senior Data Engineer with strong hands-on expertise in the Microsoft Power Platform ecosystem and Databricks to design, build, and maintain scalable data pipelines and business applications. The ideal candidate combines deep SQL and Python engineering skills with practical experience delivering low-code/pro-code solutions on Power Apps and Power Platform, enabling both robust backend data infrastructure and front-end business tooling., * 6+ years of professional experience in data engineering or a related field
- Strong hands-on experience with Databricks (Spark, Delta Lake, notebooks, job orchestration)
- Proven experience building solutions with Power Apps and Power Platform (Power Automate, Power BI is a plus)
- Advanced SQL skills (query optimization, stored procedures, complex joins/aggregations)
- Strong Python programming skills for data engineering and scripting
- Experience with cloud data platforms (Azure preferred, given Power Platform/Databricks integration)
- Solid understanding of data warehousing concepts, ETL/ELT design patterns, and data modeling
- Experience working with version control (Git) and CI/CD practices for data pipelines
Preferred Qualifications
- Experience with Azure Data Factory, Azure Synapse, or similar orchestration tools
- Familiarity with Power BI for reporting/visualization
- Experience with Delta Live Tables or Unity Catalog in Databricks
- Knowledge of data governance, security, and compliance frameworks
- Experience in an agile development environment
Soft Skills
- Strong problem-solving and analytical thinking
- Ability to communicate technical concepts to non-technical stakeholders
- Self-starter, comfortable working independently and cross-functionally, * Bachelor’s (Required)
Experience:
- Python: 6 years (Required)
- ETL: 6 years (Required)
- SQL: 6 years (Required)
- Databricks: 4 years (Required)
Benefits & conditions
Pulled from the full job description
- 401(k)
- Health insurance
- 401(k) matching
- Paid time off
- Vision insurance, * 401(k)
- 401(k) matching
- Health insurance
- Paid time off
- Vision insurance
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
How to Become an AI Engineer
Making Data Warehouses Fast: A Developer’s Story
What Are The Top Skills Required For Azure Developers?