> Markdown version of [/jobs/ext/738187-aws-data-engineer](https://www.wearedevelopers.com/jobs/ext/738187-aws-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AWS Data Engineer - **Company:** Lightning Minds Inc. - **Location:** Cary, NC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Amazon S3, Big Data, Cloud Engineering, Code Review, Computer Programming, Continuous Integration, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Warehousing, DevOps, Distributed Computing Environment, Python (Programming Language), Performance Tuning, Cloud Services, Workflow Management Systems, Data Processing, Cloud Platform System, Snowflake, Apache Spark, AWS Lambda, Git, Cloudformation, Data Lakes, Pyspark, AWS Glue, AWS Data Analytics, Apache Kafka, Video Streaming, Terraform, Data Pipelines, Amazon Elastic Mapreduce (EMR), Amazon Redshift, Databricks - **Published:** June 29, 2026 - **Apply:** https://www.dice.com/job-detail/6681c4f5-9e10-4832-9163-e7e359bd485b ## About the Role * 8+ years of Data Engineering experience. * 4+ years of hands-on AWS experience. * Strong experience with: * AWS Glue * Amazon S3 * Amazon Redshift * AWS Lambda * Amazon EMR * Amazon Athena Strong Python and PySpark programming skills. Advanced SQL development experience. Experience building scalable ETL/ELT pipelines. Experience with Spark and distributed data processing. Strong knowledge of Data Lakes and Data Warehousing. Experience with Apache Airflow or other workflow orchestration tools. Experience with Git, CI/CD, and DevOps practices. Understanding of data modelling and performance optimization. Experience working in Agile environments. Preferred Skills * Financial Services or Banking domain experience. * Knowledge of Snowflake. * Experience with Kafka or streaming technologies. * Terraform or CloudFormation experience. * Databricks experience is a plus. ## Description LPL Financial is seeking a Senior AWS Data Engineer to design, develop, and optimize scalable cloud-based data platforms and ETL pipelines using AWS services. The ideal candidate should have extensive experience in big data technologies, cloud engineering, and modern data architectures., * Design and develop cloud-native data pipelines on AWS. * Build and maintain ETL/ELT workflows. * Optimize data processing performance and scalability. * Integrate data from multiple enterprise sources. * Develop reusable data engineering frameworks. * Ensure data quality, security, and governance. * Collaborate with Architects, Data Scientists, and Business teams. * Troubleshoot production issues and optimize existing pipelines. * Participate in code reviews and mentor junior engineers. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)