Data Engineer - Snowflake / Databricks

Insight Global
Andover, MA, United States
1 day ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$156,000.0 - $197,600.0
Working hours
Regular working hours

Tech stack

Unity 3d Artificial Intelligence Amazon Web Services Microsoft Azure Continuous Integration Data Architecture Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Github Python (Programming Language)
+13 more
Machine Learning Cloud Services Standard Sql Azure Machine Learning Software Engineering Snowflake Apache Spark Git Data Lakes Data Management Cloud Integration Data Pipelines Databricks

Job description

Our client is investing in a next-generation digital platform designed to unify data, analytics, and operational insights across a globally deployed mission-critical environment. Team members will play a key role in a high-visibility modernization initiative focused on data integration, advanced analytics, AI enablement, application development, and operational readiness. This is an opportunity to build impactful solutions from the ground up, work alongside senior technical leaders, and help shape the future of a platform that supports complex operations on a global scale. If you are interested in joining this team as a Data Engineer, you will be:

  • Building the data foundation that powers next-generation strategy
  • Developing scalable data pipelines and integrations that bring together data from enterprise systems and deployed environments
  • Designing Snowflake and Databricks solutions that enable advanced analytics, reporting, and machine learning initiatives
  • Working alongside Data Scientists and Application Developers to support AI, predictive analytics, and operational dashboards
  • Playing a key role in delivering a modern data platform that improves sustainment visibility and mission readiness

The Snowflake Data Engineer specifically requires Snowflake architecture, CDC/Streams, Matillion, HVR, data governance, and cloud integration experience.

The Databricks Engineer specifically emphasizes Spark, Delta Lake, Unity Catalog, Databricks Workflows, AI/ML platforms, GenAI, RAG, LangChain, CI/CD automation, and modern Lakehouse architecture capabilities.

Requirements

5+ years of Data Engineering experience

  • Strong SQL and Python development experience
  • Expertise with either Snowflake or Databricks platforms
  • Experience building ETL/ELT pipelines and data integration solutions
  • Experience developing cloud-native data architectures
  • Understanding of data governance, data quality, and security best practices
  • Matillion for ELT pipeline development and orchestration CDC and streaming architectures

  • HVR replication
  • Delta Lake, Unity Catalog, Databricks Workflows
  • Snowflake Streams and Tasks
  • CI/CD for data platforms
  • Git, Azure DevOps, GitHub Actions
  • AWS and/or Azure cloud environments (Govcloud)
  • Medallion architecture and data modeling concepts
  • Experience supporting DoD, aerospace, or sustainment environments

Benefits & conditions

Compensation: $75-95/HR Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401K retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law., Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.insightglobal.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

2:36 min

Development tools for spatial computing and drones

Zaid Zaim Zaid Zaim · WWC 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all