> Markdown version of [/jobs/ext/3970892-data-engineer](https://www.wearedevelopers.com/jobs/ext/3970892-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** V-Soft Consulting Inc.
- **Location:** Malvern, PA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Apache HTTP Server, Information Systems, Computer Programming, Databases, Continuous Delivery, Continuous Integration, Data as a Services, Extract Transform Load (ETL), Data Mining, Data Warehousing, Distributed Computing Environment, Github, Python (Programming Language), Scrum Methodology, Cloud Services, Data Streaming, Enterprise Data Management, Jupyter Notebook, Scripting, Apache Spark, Reliability of Systems, Cloudformation, Data Lakes, Pyspark, Information Technology, AWS Glue, Apache Kafka, Terraform, Data Pipelines, Databricks
- **Published:** October 27, 2026
- **Apply:** https://www.careerbuilder.com/job-details/data-engineer-malvern-pa--bed956ee-80db-43c2-bf94-f57ecb90ff5c

## About the Role

Database Extract Transform and Load (ETL), Apache Spark, Amazon Web Services (AWS), Data Lake, Python Programming/Scripting Language, GitHub, Continuous Integration, Continuous Deployment/Delivery, Systems Reliability, Production Support, · Bachelor's degree in Computer Science or related field.

· Strong hands-on experience with Apache Spark and Glue.

· Proven ability to work with Python-based data pipelines.

· Experience with Git and GitHub Actions is mandatory., · Bachelor's degree in Computer Science, Engineering, Information

Systems, or related discipline.

· 5-7+ years of enterprise Data Engineering experience.

· Strong Python development experience.

· Advanced SQL programming skills.

· Extensive experience with Apache Spark and PySpark.

· Strong experience with Databricks application.

· Hands-on experience with AWS data services including:

o S3

o AWS Glue, · Experience building enterprise ETL and ELT pipelines.

· Experience in EMR-based Query Cluster workloads, that includes Jupyter notebooks, Park Application and ETL Pipelines.

· Strong understanding of distributed data processing.

· Experience working with large-scale cloud data platforms.

· Strong knowledge of dimensional data modeling.

· Experience implementing CI/CD pipelines.

· Familiarity with Agile/Scrum methodologies.

· Excellent communication and stakeholder management skills., · Financial Services or Asset Management industry experience.

· Knowledge of Apache Iceberg, Delta Lake, or Hudi.

· Experience with Airflow.

· Knowledge of Kafka or Kinesis streaming.

· Experience supporting AI/ML and advanced analytics platforms.

· AWS Professional or Specialty Certifications.

## Description

· Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.

· Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.

· Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.