> Markdown version of [/jobs/ext/553049-data-engineer](https://www.wearedevelopers.com/jobs/ext/553049-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** IBA InfoTech Inc.
- **Location:** Durham, NC, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Computer-Aided Design, Amazon Web Services, Big Data, Cloud Computing, Code Review, Programming Tools, Distributed Systems, Elasticsearch, Fault Tolerance, Apache Hadoop, Apache Hive, Information Lifecycle Management, Python (Programming Language), Data Streaming, Apache Spark, Information Technology, Druid, Apache Flink, Cassandra, Data Analytics, Presto, Stream Processing, Data Pipelines, Programming Languages
- **Published:** June 14, 2026
- **Apply:** https://ibainfotech.com/senior-data-engineer-3

## About the Role

* You have a strong engineering background with ability to design software systems from the ground up.
 * You have expertise in Java, Python or similar programming languages.
 * You have experience in web-scale data and large-scale distributed systems, ideally on cloud infrastructure.
 * You have a product mindset. You are energized by building things that will be heavily used.
 * You have engineered scalable software using big data technologies (e.g. Hadoop, Spark, Hive, Presto, Flink, Samza, Storm, Elasticsearch, Druid, Cassandra, etc).
 * You have experience building data pipelines (real-time or batch) on large complex datasets.
 * You have worked on and understand messaging/queueing/stream processing systems.
 * You design not just with a mind for solving a problem, but also with maintainability, testability, monitorability, and automation as top concerns.

## Description

* Develop and deploy highly-available, fault-tolerant software that will help drive improvements towards the features, reliability, performance, and efficiency of the Cloud Analytics platform.
 * Actively review code, mentor, and provide peer feedback.
 * Collaborate with engineering teams to identify and resolve pain points as well as evangelize best practices.
 * Partner with various teams to transform concepts into requirements and requirements into services and tools.
 * Engineer efficient, adaptable and scalable architecture for all stages of data lifecycle (ingest, streaming, structured and unstructured storage, search, aggregation) in support of a variety of data applications.
 * Build abstractions and re-usable developer tooling to allow other engineers to quickly build streaming/batch self-service pipelines.
 * Build, deploy, maintain, and automate large global deployments in AWS.
 * Troubleshoot production issues and come up with solutions as required.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Making Data Warehouses fast. A developer's story.](https://www.wearedevelopers.com/videos/302-making-data-warehouses-fast-a-developer-s-story)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)