> Markdown version of [/jobs/ext/1999898-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1999898-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Hilton Inc. - **Location:** Richmond, VA, United States (Remote available) - **Experience:** Expert - **Salary:** $170,000.0 - $185,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Data Analysis, Apache HTTP Server, Big Data, Cloud Computing, Computer Engineering, Continuous Integration, Information Engineering, Data Governance, Data Infrastructure, Data Systems, DevOps, Distributed Computing Environment, Apache Hadoop, MapReduce, Apache Hive, Python (Programming Language), Machine Learning, Microsoft SQL Server, MySQL, NoSQL, Object-Oriented Software Development, Performance Tuning, Cloud Services, Software Engineering, SQL Databases, Privacy Controls, Feature Engineering, Data Ingestion, Apache Spark, Data Lakes, Deployment Automation, AWS Glue, AWS Data Analytics, Machine Learning Operations, Virtual Agents, Restful APIs, Software Version Control, Amazon Elastic Mapreduce (EMR), Amazon Redshift - **Published:** August 9, 2026 - **Apply:** https://www.techcareers.com/job.asp?id=3347461520&tx=CT2927TTZ&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54 ## About the Role Requires Master's degree or foreign equivalent in Business Analytics, Computer Science and Engineering, or related field and three years of experience in Data Engineering, Analytics, or related occupation. Alternatively, Bachelor's degree or foreign equivalent in Business Analytics, Computer Science and Engineering, or related field and five years of experience in Data Engineering, Analytics, or related occupation required. Must have progressive experience in application development and object-oriented programming using Scala and Python; working with large data sets, Hadoop, data lakes, and cloud technologies; utilizing SQL and NoSQL databases such as Hive, AWS Redshift, Microsoft SQL Server, MySQL, and REST API integration; leveraging cloud-based services, such as AWS Glue, EMR, or Athena for scalable data engineering; implementing distributed computing frameworks, such as Apache Spark, Hadoop MapReduce, and Apache; and applying DevOps tools and CI/CD practices. ## Description Design, develop, and implement machine learning pipelines (batch and real-time) to support forecasting, marketing, revenue management, and customer behavior analytics. Develop innovative data solutions that enable revenue optimization, personalization, and data-driven decision-making across business functions with minimal oversight. Apply industry-standard software engineering principles throughout the lifecycle, including requirements gathering, design, development, testing, deployment, and monitoring. Build and optimize scalable data ingestion, transformation, and processing workflows using distributed computing frameworks. Leverage cloud-based services, including AWS Data Pipeline, AWS Glue, AWS EMR to design reliable, high-performance data infrastructure. Implement robust data modeling, feature engineering, and data quality validation to support production-grade machine learning and AI solutions. Collaborate with data scientists, analysts, and business stakeholders to translate analytical needs into deployable systems. Troubleshoot and resolve production defects while implementing long-term fixes. Lead and mentor junior engineers in best practices for big data engineering, AI-driven applications, version control, CI/CD, and DevOps automation. Ensure compliance with enterprise data governance, security, and privacy standards, while conducting performance tuning of large-scale pipelines. Research and recommend emerging technologies in AI, cloud, and data engineering to enhance enterprise capabilities. ## Related Videos - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)