> Markdown version of [/jobs/ext/3589999-data-engineer](https://www.wearedevelopers.com/jobs/ext/3589999-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Indotronix Avani Group - **Location:** McLean, VA, United States - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Amazon Web Services, Big Data, Continuous Integration, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Distributed Systems, Amazon DynamoDB, Identity and Access Management, Machine Learning, E2e Testing, Cloud Services, Software Deployment, Software Engineering, Data Streaming, System Testing, Software Vulnerability Management, Apex Code, Data Processing, Test-Driven Development (TDD), Data Ingestion, Apache Spark, Git, Event Driven Architecture, Containerization, Kubernetes, Apache Flink, AWS Glue, Machine Learning Operations, Software Version Control, Databricks - **Published:** October 5, 2026 - **Apply:** https://candidateportal.ceipal.com/job-details/cHGdyiH93rGO_3HuwTazXRkfDf9pUkJGF5Swx00gxTQ ## About the Role Proven experience in Python development within enterprise-scale environments. - Hands-on expertise with AWS services: Lambda, ECS, Kinesis, S3, DynamoDB, IAM, CDK. - Proficiency with Spark and AWS Glue for large-scale data processing. - Experience with Git, source control management, and CI/CD pipelines. - Databricks experience for collaborative analytics and processing. - Demonstrated success building and supporting cloud-native data pipelines and ingestion frameworks. - Strong foundation in Infrastructure as Code, data validation, transformation, and data quality. - In-depth knowledge of secure software development and vulnerability remediation. - End-to-end testing, system testing, and production deployment support. - Exceptional troubleshooting skills in distributed systems. Preferred Skills - Experience in financial services or regulated data environments. - Expertise in sensitive data handling, tokenization, or data governance. - Familiarity with Apache Flink, real-time streaming, and event-driven architectures. - Knowledge of containerized deployments and orchestration platforms. - Background in automated testing frameworks and test-driven development. - AWS certifications (e.g., Solutions Architect Associate, Developer Associate). - Agile team experience., Must haves:-- Required SkillsPython development in enterprise-scale environmentsAWS services including: Lambda ECS Kinesis S3m DynamoDB IAM and CDKSpark and AWS Glue for large-scale data processingGit source control management and CI/CD pipelinesDatabricks--Required Knowledge & ExperienceExperience building and supporting cloud-native data pipelines and data ingestion frameworksExperience developing and maintaining Infrastructure as Code solutionsStrong understanding of d Transformation and data quality practicesKnowledge of secure software development practices and vulnerability remediationExperience supporting end-to-end testing System testing and production deploymentsStrong problem-solving and troubleshooting skills in distributed systems environments ## Description Join a rapidly growing AI and data engineering team as a Data Engineer, developing and supporting cloud-native data ingestion solutions in a hybrid Richmond, VA environment. You will architect, build, and optimize critical data pipelines that enable secure and compliant movement of financial data between enterprise systems and third-party applications. This role offers long-term career growth, hands-on experience with advanced ML Ops and ML engineering tools, and daily collaboration with experts in AWS-native technologies., Design, build, and maintain scalable data pipelines using Python and AWS-native services. - Develop robust workflows for data ingestion, validation, tokenization, transformation, and publishing. - Implement and manage distributed data processing solutions using AWS Glue, Spark, Lambda, ECS, and Flink. - Develop and maintain cloud infrastructure with AWS CDK and Infrastructure as Code best practices. - Create and execute comprehensive unit, integration, and end-to-end tests to ensure platform stability. - Monitor, troubleshoot, and resolve production issues across the entire data platform. - Ensure data security and compliance with enterprise data protection and governance standards. - Remediate security vulnerabilities and manage platform dependencies. - Collaborate closely with engineering and platform teams to deliver high-performing, reliable data solutions. - Contribute to CI/CD pipelines and modern software engineering practices. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Tips, Techniques, and Common Pitfalls Debugging Kafka](https://www.wearedevelopers.com/videos/838-tips-techniques-and-common-pitfalls-debugging-kafka) ## Related Articles - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)