Data Engineer
Barnes Inc.
Bristol, CT, United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Business Intelligence Development
Cloud Database
Data Validation
Information Engineering
Data Governance
Data Integration
Extract Transform Load (ETL)
Data Mining
Data Warehousing
Database Queries
Apache Hive
+28 more
Python (Programming Language)
Microsoft SQL Server
Performance Tuning
Query Optimization
Power BI
Migration Manager
Azure Data Lake
SQL Stored Procedures
SQL Databases
SQL Server Agent
SQL Server Integration Services
Transact-SQL
Cloud Platform System
Azure Data Factory
Database Optimization
Apache Spark
Technical Debt
Git
Data Lakes
Pyspark
Data Lineage
Collibra
Data Analytics
Star Schema
Tools for Reporting
Software Version Control
Data Pipelines
Databricks
Job description
- Maintain and enhance SSIS packages for data extraction, transformation, and loading
- Support SQL Server data warehouse (staging, ODS, reporting layers)
- Troubleshoot data issues, job failures, and performance bottlenecks
- Optimize SQL queries, stored procedures, and indexing strategies
- Ensure reliability of scheduled jobs via SQL Server Agent
Cloud Data Engineering (Azure + Databricks)
- Design and develop data pipelines using Azure Data Factory (ADF)
- Ingest and organize data into Azure Data Lake (Bronze/Silver/Gold layers)
- Build scalable data transformations using Databricks (Spark SQL, PySpark)
- Create curated, analytics-ready datasets for Power BI
- Implement Delta Lake and support data governance (e.g., Unity Catalog)
Migration & Modernization
- Analyze and document existing SSIS/SQL pipelines
- Translate legacy ETL processes into modern ELT patterns
- Support phased migration strategy (coexistence of legacy and modern platforms)
- Reduce technical debt and improve pipeline maintainability
- Establish standards for data modeling, naming, and architecture
Data Modeling & Business Value Creation
- Design dimensional models (fact and dimension tables) aligned to business processes
- Integrate and standardize data across multiple ERP systems
- Translate business requirements into scalable data solutions
- Partner with stakeholders to identify high-impact use cases for data and analytics
- Deliver datasets that enable reporting, forecasting, and operational insights
Data Quality & Governance
- Implement data validation, reconciliation, and monitoring processes
- Ensure data accuracy and consistency across systems during migration
- Define and enforce data quality standards and controls
- Support data lineage, documentation, and transparency initiatives
Collaboration & Stakeholder Engagement
- Work closely with business stakeholders, analysts, and BI developers
- Support Power BI semantic models and reporting solutions
- Communicate technical solutions in business terms
- Act as a bridge between IT/data teams and business functions
Requirements
- 4-8+ years of experience in data engineering or data warehousing
- Strong SQL skills (T-SQL and/or Spark SQL)
- Hands-on experience with SSIS and SQL Server
- Experience with Azure Data Factory (ADF) or similar tools
- Experience with Databricks (Spark, Delta Lake, or similar platforms)
- Solid understanding of data warehousing concepts (star schema, fact/dimension modeling)
- Experience integrating data from multiple source systems (ERP experience preferred)
- Proven ability to translate business requirements into technical solutions, * Experience migrating legacy ETL systems (SSIS) to cloud-based architectures
- Proficiency in Python or PySpark
- Familiarity with Medallion architecture (Bronze/Silver/Gold)
- Experience with Power BI data modeling and performance optimization
- Knowledge of data governance tools (e.g., Unity Catalog)
- Experience with Git and CI/CD pipelines
- Exposure to dbt or similar frameworks
Technical Skills
- SQL Server (T-SQL), SSIS
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Databricks (Spark SQL, PySpark, Delta Lake)
- Data modeling (Kimball methodology preferred)
- Performance tuning and query optimization
- Version control (Git)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on jobs.localjobnetwork.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago