Data Engineer II (SQL/Databricks)
Colossus Technologies Group
Waltham, United States of America
4 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Remote
Waltham, United States of America
Tech stack
Amazon Web Services (AWS)
Azure
Continuous Integration
ETL
Relational Databases
DevOps
Python
PostgreSQL
Microsoft SQL Server
Online Transaction Processing
Power BI
Standard Sql
SQL Databases
Cloud Platform System
Data Ingestion
Spark
GIT
Terraform
Software Version Control
Databricks
Job description
We're partnering with a modern data platform company. They are scaling their data team and adding a hands-on Data Engineer who can own work across the full stack - from ingestion and modeling through to BI and stakeholder insights. You'll work in a small, collaborative team where you drive both technical execution and prioritization, with very little heavy product management overhead. If you like taking a problem from idea to data model to dashboard, this is for you.
What you'll work on
- Building and maintaining data models and transformations in Databricks
- Writing and optimizing SQL against SQL Server and PostgreSQL source systems
- Enhancing Python-based ingestion pipelines into the lakehouse
- Developing Databricks SQL views and functions for analytics use cases
- Supporting existing Power BI dashboards and helping migrate to a new BI platform
- Using Git and Databricks Asset Bundles for version control and deployments
Requirements
- 3+ years in data, analytics, or a related role
- Strong SQL (queries, views, transformations) and experience with relational databases (SQL Server or similar OLTP)
- Hands-on Python in a data context (ETL, pipelines, scripting)
- Exposure to Databricks, Spark, or a major cloud data platform (AWS, Azure, or GCP)
- Experience with BI tools (Power BI or similar) and Git/GitHub
Nice to have
- Experience with CI/CD, DevOps, or infrastructure-as-code (Terraform, Azure DevOps, Databricks Asset Bundles)
- Understanding of dimensional or lakehouse/medallion data modeling concepts
Who will thrive here
- You like working autonomously and owning projects end to end
- You're comfortable prioritizing in a fast-moving environment
- You can communicate clearly with both technical and non-technical stakeholders