> Markdown version of [/jobs/ext/1893548-data-engineer](https://www.wearedevelopers.com/jobs/ext/1893548-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Everforth Apex - **Location:** Richmond, VA, United States - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Amazon S3, Big Data, Continuous Integration, Data Validation, Data Governance, Data Infrastructure, Data Integrity, Data Systems, Distributed Computing Environment, Distributed Systems, Amazon DynamoDB, Identity and Access Management, Python (Programming Language), E2e Testing, Cloud Services, Software Construction, Software Deployment, Software Engineering, System Testing, Tokenization, Software Vulnerability Management, AWS Cdk, Data Processing, Test-Driven Development (TDD), Data Ingestion, Apache Spark, Git, Event Driven Architecture, Kubernetes, Infrastructure Automation Frameworks, Apache Flink, AWS Glue, Stream Processing, Software Version Control, Data Pipelines, Databricks - **Published:** August 2, 2026 - **Apply:** https://www.dice.com/job-detail/09cac3ff-4303-4f9a-99a6-0007b90f6e8b ## About the Role * Experience with Python development in enterprise-scale environments. * Hands-on experience with AWS services, including: Lambda, ECS, Kinesis, S3, DynamoDB, IAM, and CDK. * Proficiency with Spark and AWS Glue for large-scale data processing. * Experience with Git, source control management, and CI/CD pipelines. * Experience with Databricks. * Experience building and supporting cloud-native data pipelines and data ingestion frameworks. * Experience developing and maintaining Infrastructure as Code solutions. * Understanding of data validation, transformation, and data quality practices. * Knowledge of secure software development practices and vulnerability remediation. * Experience supporting end-to-end testing, system testing, and production deployments. * Problem-solving and troubleshooting skills in distributed systems environments. Preferred Qualifications * Experience working with financial services or highly regulated data environments. * Experience supporting sensitive data handling, tokenization, or data governance initiatives. * Familiarity with Apache Flink and real-time stream processing architectures. * Experience building event-driven architectures using AWS services. * Knowledge of containerized application deployments and orchestration platforms. * Experience with automated testing frameworks and test-driven development practices. * AWS certifications such as AWS Solutions Architect Associate or AWS Developer Associate. * Experience working within Agile software development teams. ## Description We are seeking a Data Engineer to join a team focused on building and supporting a Python-based, AWS-native data ingestion platform. This platform is responsible for moving and transforming critical financial data from source systems into third-party applications while ensuring compliance, security, and data integrity throughout the data lifecycle. The Data Engineer will be responsible for developing, maintaining, and enhancing data pipelines across multiple processing stages. This role requires collaboration with engineering and platform teams to ensure scalable, secure, and reliable data processing solutions within a cloud-native AWS environment., * Design, develop, and maintain data pipeline components using Python and AWS-native services. * Build and support data ingestion, validation, tokenization, reformatting, and publishing workflows. * Develop and maintain infrastructure using AWS CDK and Infrastructure as Code practices. * Support and enhance distributed data processing solutions using Glue, Spark, Lambda, ECS, and Flink. * Create and execute comprehensive unit, integration, and end-to-end testing strategies to ensure platform reliability. * Participate in system testing and end-to-end validation efforts across multiple environments. * Monitor, troubleshoot, and remediate production issues across pipelines and supporting infrastructure. * Ensure compliance with enterprise data protection standards, including sensitive data handling and governance requirements. * Address security findings, vulnerability remediation, and dependency management across the platform ecosystem. * Collaborate with cross-functional teams to deliver scalable, maintainable, and high-performing data solutions. * Contribute to CI/CD processes and software engineering best practices throughout the development lifecycle. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Building Reliable Serverless Applications with AWS CDK and Testing](https://www.wearedevelopers.com/videos/812-building-reliable-serverless-applications-with-aws-cdk-and-testing) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)