> Markdown version of [/jobs/ext/524641-data-engineer-purchasing-power-open-to-relocation-hybrid-atlanta-ga](https://www.wearedevelopers.com/jobs/ext/524641-data-engineer-purchasing-power-open-to-relocation-hybrid-atlanta-ga). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Purchasing Power (Open to Relocation | Hybrid - Atlanta, GA) - **Company:** Purchasing Power - **Location:** Atlantic, IA, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Business Logic, Computing Platforms, Directed Acyclic Graph (Directed Graphs), Information Engineering, Data Infrastructure, Data Transformation, Database Queries, Software Debugging, Distributed Data Store, Distributed Systems, Greenplum, Performance Tuning, Data Streaming, Data Processing, Data Ingestion, Apache Spark, Pyspark, Apache Kafka, Data Delivery, Kibana, Data Pipelines - **Published:** June 10, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=22e655b4af48f506 ## About the Role Do you have experience in Technical troubleshooting support?, * 3-5+ years of experience in data engineering or distributed data systems * Hands-on experience building and maintaining pipelines using Spark / PySpark * Experience working with Kafka or other streaming platforms * Strong SQL skills and experience with data transformation * Experience with data orchestration tools such as Apache Airflow * Familiarity with AWS -based data environments * Strong troubleshooting and debugging skills for data pipelines * Curiosity, adaptability, and comfort working in evolving technical environments * AI-enabled tools are already part of how work gets done across our organization, and their use will continue to expand over time. We value people who are curious, adaptable, and open to learning as roles and workflows evolve. ## Description You'll work closely with the Senior Director of Data Engineering and platform team to design, build, and maintain streaming and batch data pipelines, supporting real-time ingestion, transformation, and delivery into analytics and reporting systems. This is a great opportunity for someone who enjoys working in distributed systems and wants to have a direct impact on how data is delivered across the business., * Develop and maintain streaming and batch data pipelines using Kafka , Spark, and related technologies * Implement ingestion pipelines using Kafka Connect and CDC patterns * Build transformation and enrichment processes using Spark and PySpark * Ensure reliable data delivery to downstream platforms including Greenplum, Elastic, S3, and analytics tools Streaming Platform Support * Support Kafka topic configuration, partitioning strategies, and consumer group management * Assist with schema registration and schema evolution practices * Troubleshoot streaming pipeline issues and optimize performance * Help maintain data integrity and reliability across distributed systems Data Processing & Transformation * Implement business logic and transformations within Spark processing frameworks * Develop and maintain Airflow DAGs (or equivalent orchestration workflows) * Build lookup and enrichment logic for streaming and batch pipelines * Ensure data quality through validation, monitoring, and alerting practices Platform Operations * Monitor pipeline performance, failures, and data latency * Assist with observability and monitoring using tools such as Elastic and Kibana * Support incident resolution and root-cause analysis for data pipeline issues * Contribute to system performance tuning and platform optimization Collaboration * Work closely with the Data Engineering Manager to implement platform architecture * Partner with analytics and reporting teams to support BI and data delivery needs * Assist with evolving platform integrations and modernization initiatives, * We act with intensity, urgency, and a passion for supporting our customers and growing our business * We hold ourselves accountable and approach challenges with a positive, "can-do" mindset * We deliver as one team, working with integrity, trust, transparency, and respect * We believe diversity, authenticity, and curiosity make us better and fuel innovation * We continuously ask: Is there a better way? ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Debug a Kubernetes Operator](https://www.wearedevelopers.com/videos/487-debug-a-kubernetes-operator) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)