Senior Data Engineer

Vsg Business Solutions
Malvern, PA, United States
7 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$120,000.0 - $145,000.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Amazon S3 Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Python (Programming Language) SQL Databases Cloud Platform System Snowflake Apache Spark
+6 more
Git Data Lakes Pyspark Apache Kafka Data Pipelines Databricks

Job description

We are seeking a Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to build and optimize scalable data pipelines supporting enterprise analytics. The ideal candidate should have hands-on experience with cloud-based data platforms, ETL/ELT development, and Lakehouse architecture. Responsibilities

  • Develop and maintain ETL/ELT pipelines using Databricks and PySpark.
  • Design and optimize scalable data solutions on AWS.
  • Build data pipelines using Delta Lake and Medallion Architecture.
  • Write efficient SQL queries and optimize Spark jobs.
  • Collaborate with Data Engineers, Architects, and Business teams.
  • Ensure data quality, performance, and reliability., Role: Senior Databricks Engineer Location: Malvern, PA Fulltime Salary Range: $120,000-$145,000/Year We need strong Databricks Platform engineering experience with AWS cloud e…
  • 6 days ago +

Requirements

  • 6+ years of Data Engineering experience.
  • Strong hands-on experience with Databricks, PySpark, Python, and SQL.
  • Experience with AWS (S3, Glue, Redshift).
  • Knowledge of Delta Lake, ETL/ELT, and data modeling.
  • Experience with Git and CI/CD.
  • Excellent communication skills.

Preferred

  • Unity Catalog
  • Delta Live Tables (DLT)
  • Airflow
  • Kafka
  • Snowflake
  • Financial Services experience (preferred)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all