Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+13 more
Job description
In addition to this newly created Data Engineer position, the VP of IT & Data Analytics is adding an Enterprise Solutions Team Lead, whom this role will eventually report to., * Build data pipelines from the ground up, moving data from ERP systems and APIs through a Medallion Architecture using Bronze, Silver, and Gold Lakehouse layers in Microsoft Fabric.
- Partner with data leadership to select and implement ETL/ELT tools and processes that replace the organization’s current manual data-processing methods.
- Support a combination of batch loads for static master data and near-real-time data flows as the pipeline environment matures.
- Collaborate with the Enterprise Solutions Team Lead and business stakeholders to design and improve data pipelines.
- Deliver clean, validated, analytics-ready data to the Power BI, Power Automate, and Power Apps analyst team.
- Build and maintain pipelines using Azure Data Factory, Microsoft Fabric, and Azure Data Lake technologies.
- Use GitHub and DevOps practices to manage source control, code changes, and data pipeline deployments.
- Troubleshoot data-quality and pipeline issues to maintain data integrity for downstream reporting and analytics.
Requirements
- Strong hands-on experience using Python and SQL for data engineering.
- Experience building and maintaining data pipelines using Azure Data Factory or a similar platform.
- Familiarity with Microsoft Fabric, Azure Data Lake, or comparable data lake technologies.
- Understanding of Medallion Architecture and Bronze, Silver, and Gold Lakehouse data-layering concepts.
- Experience using GitHub and DevOps practices for source control and pipeline deployment.
- Experience working within an established data warehouse or Lakehouse environment.
- Ability to support both batch and near-real-time data processing.
- Experience integrating data from ERP systems and APIs into a centralized data platform.
BONUS SKILLS AND OPPORTUNITIES TO GROW
- Experience designing or building a data warehouse or Lakehouse environment from the ground up.
- Experience evaluating, selecting, or implementing ETL/ELT tools for an organization transitioning away from manual processes.
- Experience supporting data initiatives involving artificial intelligence or machine learning.
- Interest in growing into a data architecture role as the organization’s data function continues to mature.
Benefits & conditions
- Generous paid time off
- Annual bonus opportunity
Pay: $100,000.00 - $110,000.00 per year
About the company
Join a well-established and growing organization in the industrial services sector with a strong reputation for stability throughout the Northeast.
The company is undergoing a major systems modernization initiative following a significant acquisition. This creates a rare opportunity for a Data Engineer to help build the organization’s data infrastructure from the ground up rather than inherit an established legacy environment., ETL and ELT processing is currently performed manually, giving you meaningful autonomy to work alongside data leadership in selecting the tools, technologies, and approaches that will define how data moves across the business for years to come.
This role will operate within a modern Azure and Microsoft Fabric environment.
This position may be performed remotely by candidates who are not local to Buffalo, NY.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK
The Most Popular IT Jobs on the Market
How to Become an AI Engineer