> Markdown version of [/jobs/ext/4613068-data-engineer-pyspark](https://www.wearedevelopers.com/jobs/ext/4613068-data-engineer-pyspark). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer - PySpark

- **Company:** Highbrow LLC
- **Location:** Durham, NC, United States
- **Experience:** Expert
- **Contract:** Contract
- **Skills:** Agile Methodology, Airflow, Amazon Web Services, Microsoft Azure, Big Data, BigQuery, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Warehousing, Database Queries, Distributed Computing Environment, Distributed Systems, Apache Hive, Python (Programming Language), Query Optimization, Cloud Services, SQL Databases, Data Streaming, Workflow Management Systems, Data Processing, Google Cloud, Cloud Platform System, Azure Data Factory, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Kubernetes, AWS Glue, Apache Kafka, Spark Streaming, Azure Synapse Analytics, Data Pipelines, Docker, Amazon Redshift, Databricks
- **Published:** November 7, 2026
- **Apply:** https://www.dice.com/job-detail/eee7f5ac-4563-4205-9b5e-6f7e01fd6162

## About the Role

* 8+ years of experience in Data Engineering or related roles.
 * Strong hands-on experience with Python and PySpark.
 * Extensive experience with Apache Spark, Spark SQL, and distributed data processing.
 * Strong proficiency in SQL, including complex queries, joins, aggregations, and query optimization.
 * Experience developing and maintaining large-scale ETL/ELT data pipelines.
 * Strong understanding of data warehousing concepts, data modeling, and data lake architectures.
 * Experience working with cloud data platforms such as AWS, Azure, or Google Cloud Platform.
 * Experience with technologies such as Databricks, Delta Lake, Hive, or similar big data frameworks.
 * Knowledge of workflow orchestration tools such as Apache Airflow, Azure Data Factory, or AWS Glue.
 * Experience with Git, CI/CD pipelines, and Agile development methodologies.
 * Strong analytical, troubleshooting, and problem-solving skills.

Preferred Qualifications

 * Experience with streaming data processing using Kafka or Spark Streaming.
 * Exposure to Snowflake, Redshift, BigQuery, or Azure Synapse.
 * Experience implementing data governance and data quality frameworks.
 * Familiarity with Docker, Kubernetes, and cloud-native data engineering solutions.

Work Requirements

 * Location: Raleigh, NC.
 * Hybrid work arrangement with onsite presence required.
 * Must be willing to work on W2.
 * 8+ years of relevant professional experience required.

## Description

We are looking for an experienced Data Engineer with strong PySpark expertise to design, develop, and maintain scalable data processing solutions. The ideal candidate will have extensive experience in big data technologies, distributed computing, ETL/ELT development, and cloud-based data platforms.

The candidate should be comfortable working with large datasets, building efficient data pipelines, optimizing Spark workloads, and collaborating with cross-functional teams to deliver reliable data solutions.