> Markdown version of [/jobs/ext/2814721-data-engineer](https://www.wearedevelopers.com/jobs/ext/2814721-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Lightning Minds Inc.
- **Location:** Cary, NC, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Amazon Web Services, Amazon S3, Profiling, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Systems, Python (Programming Language), Cloud Services, SQL Databases, Git, Pyspark, AWS Data Analytics, Api Gateway, Data Pipelines
- **Published:** September 10, 2026
- **Apply:** https://www.dice.com/job-detail/3d540518-83b5-4272-9309-c516b19d99c3

## About the Role

* 5+ years of experience in data engineering.
 * Handson expertise with AWS Data Engineering stack (S3, Glue, Redshift, EMR, Lambda, RDS).
 * Strong proficiency in Python, PySpark, and SQL.
 * Solid understanding of data modeling, orchestration, and integration.
 * Experience with CI/CD pipelines, Git, and Agile methodologies.
 * Excellent problemsolving and communication skills.

## Description

Overview: We are looking for an experienced Data Engineer with strong expertise in AWS cloud technologies to design, build, and optimize scalable data pipelines. This role involves working closely with crossfunctional teams to deliver highquality data solutions that support analytics, reporting, and business intelligence initiatives., * Develop and maintain ETL/ELT pipelines using Python, PySpark, and SQL.

 * Design and implement data models and integrations across multiple sources.
 * Leverage AWS services (S3, Glue, Lambda, Redshift, RDS, EMR, API Gateway) for data engineering solutions.
 * Ensure data quality, profiling, and governance across platforms.
 * Collaborate with stakeholders to define requirements and deliver endtoend solutions.
 * Optimize performance, scalability, and cost efficiency of cloud data platforms.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)