WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer

Techgroup America Inc.
United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source
www.dice.com

Tech stack

Extract Transform Load (ETL) PostgreSQL Microsoft SQL Server MongoDB Standard Sql Apache Spark Data Lakes Pyspark Data Pipelines Databricks

Job description

The team is moving from CosmosDB to Databricks and is looking for a Senior Data Engineer who can help model and migrate existing data processes into the new environment. The selected candidate will work closely with the team to build scalable data solutions and help take ownership of existing workloads.

Requirements

  • 3+ years of recent hands-on experience working with Databricks.
  • Strong experience using Databricks to build end-to-end data pipelines.
  • Strong understanding of data modeling and schema design.
  • Experience optimizing data pipeline and platform performance.
  • Ability to work independently while collaborating effectively with existing technical teams.

Required Technical Skills

  • Databricks
  • ETL Optimization
  • PySpark
  • SQL
  • Spark Declarative Pipelines
  • Unity Catalog
  • Data Modeling
  • Delta Lake / Delta Tables
  • PostgreSQL
  • MS SQL Server
  • CosmosDB / MongoDB

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:01 min

Migrating existing applications from MongoDB to Postgres

Nikita Shamgunov Nikita Shamgunov · World Congress 2024

5:37 min

Extensibility and programmability features of the PostgreSQL database

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

47 sec

Building modern data pipelines for legacy exports

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

1:21 min

Realizing the limitations of MongoDB for live statistics

Josip Stuhli Josip Stuhli · World Congress 2023

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search thumbnail
26:04
World Congress 2025 • about 1 year ago

Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search

Dharin Shah

Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs thumbnail
47:16
World Congress 2021 • about 5 years ago

40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs

Maxime Beugnet

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Related articles

See all