> Markdown version of [/jobs/ext/2621468-data-engineer](https://www.wearedevelopers.com/jobs/ext/2621468-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Horizontal Talent
- **Location:** Arlington, VA, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Apache ActiveMQ, Adobe InDesign, Airflow, Big Data, BigQuery, Cloud Database, Computer Programming, Databases, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Apache Hadoop, Hadoop Distributed File System, Apache HBase, Apache Hive, Python (Programming Language), PostgreSQL, Messaging Application Programming Interface, Microsoft SQL Server, SQL Azure, MongoDB, MySQL, NoSQL, Oracle (Applications), Performance Tuning, RabbitMQ, Talend, Cloud Platform System, Apache Spark, Indexer, Collibra, Apache Flink, Cassandra, Apache Kafka, Apache Nifi, Spark Streaming, Data Management, Data Pipelines, Amazon Redshift, Microservices
- **Published:** August 12, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=277dfafa5362d4e2

## About the Role

* 4+ years of relevant experience working with big data technologies
 * Hands-on experience with Hadoop ecosystem tools such as HDFS, Kafka, Spark, Spark Streaming, Hive, Airflow, NiFi, Flink, or similar technologies
 * Strong programming skills in Java, Scala, or Python, with Java preferred
 * Experience working with NoSQL and MPP data platforms such as HBase, MongoDB, Cassandra, Redshift, Azure SQL DW, or BigQuery
 * Working knowledge of AWS data platform services
 * Ability to design and implement data engineering solutions independently
 * Strong problem-solving, communication, and collaboration skills
 * Bachelor's degree or equivalent combination of education, training, and experience, * Experience with ETL tools such as Informatica or Talend
 * Familiarity with databases such as Oracle, MySQL, SQL Server, or Postgres
 * Knowledge of data governance practices including security, lineage, and cataloging
 * Exposure to tools such as Collibra or Alation
 * Understanding of messaging frameworks such as ActiveMQ, RabbitMQ, or Solace
 * Experience with search and indexing technologies
 * Background in microservices architecture
 * Experience with performance tuning and pipeline optimization
 * Cloud data certifications or other relevant big data credentials

Horizontal is committed to fostering an inclusive and welcoming environment where different perspectives are valued and every team member can contribute meaningfully. We believe diversity, equity, and inclusion strengthen our teams and help drive better outcomes for everyone.

## Description

* Design, build, and support data pipelines that handle batch and real-time ingestion from multiple sources
 * Develop solutions for data integration, transformation, storage, search, and aggregation
 * Work across big data frameworks and platforms to improve scalability, reliability, and performance
 * Collaborate with technical teams to translate business needs into practical data engineering solutions
 * Participate in design discussions and help ensure the overall health of the solution architecture
 * Support data engineering efforts involving cloud-based infrastructure and analytics use cases
 * Contribute to troubleshooting, optimization, and enhancement of existing data workflows


## Related Videos

- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)