Data Engineer

Proteam Solutions
Dublin, OH, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Application Frameworks Microsoft Azure Computer Programming Continuous Integration Information Engineering Extract Transform Load (ETL) Data Warehousing Distributed Data Store Apache Hive Performance Tuning
+11 more
Data Streaming Delivery Pipeline Apache Spark Git Data Layers Build Management Data Lakes Pyspark Integration Frameworks Data Pipelines Databricks

Job description

We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, develop, and optimize enterprise-scale data pipelines. You’ll play a key role in building scalable Lakehouse solutions while ensuring reliable, high-quality data for analytics, reporting, and downstream applications., * Design and build scalable ETL/ELT pipelines using Databricks

  • Develop PySpark and Spark SQL transformations
  • Build Bronze, Silver, and Gold data layers using Medallion Architecture
  • Implement Delta Live Tables, Workflows, and Unity Catalog
  • Optimize Spark jobs for scalability and performance
  • Design dimensional data models for analytical workloads
  • Implement data quality validations and monitoring
  • Collaborate with analytics, engineering, and architecture teams
  • Build reusable frameworks and automation
  • Support CI/CD deployment pipelines and Git-based development

Requirements

  • 7-10+ years of Data Engineering experience
  • Extensive hands-on Databricks experience
  • Strong PySpark programming
  • Advanced Spark SQL skills
  • Experience with Delta Lake
  • Experience implementing Medallion Architecture
  • Hands-on Delta Live Tables
  • Unity Catalog experience
  • Strong SQL optimization and performance tuning
  • Experience with AWS, Azure, or GCP
  • CI/CD and Git experience
  • Strong understanding of distributed data systems
  • Experience designing enterprise data models, * Databricks certification
  • Experience with streaming data
  • Experience building reusable data frameworks
  • Experience with enterprise governance
  • Exposure to AI-assisted development tools including Databricks AI Genie

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all

Related articles

See all