> Markdown version of [/jobs/ext/2551864-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/2551864-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Big Data Engineer

- **Company:** BCforward
- **Location:** Addison, TX, United States
- **Experience:** Expert
- **Salary:** $104,000.0
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Amazon Web Services, CA Workload Automation Ae, Microsoft Azure, Big Data, Cloud Database, Continuous Integration, Data Warehousing, Relational Databases, Distributed Systems, Apache Hadoop, Apache Hive, Python (Programming Language), Unix Shell, Performance Tuning, Query Optimization, Cloudera, Scala (Programming Language), SQL Databases, Data Processing, Apache Spark
- **Published:** August 28, 2026
- **Apply:** https://www.dice.com/job-detail/fc3866f1-4cd2-40c5-91c6-37604d8b6e1e

## About the Role

We are seeking a Big Data Engineer to join our dynamic team. The ideal candidate will have strong experience in Hadoop and Spark within the Cloudera ecosystem, data warehousing, and distributed systems and a proven ability to build and optimize scalable big data pipelines in production., * Bachelor's degree in a technical or business-related field or equivalent experience.

 * 5+ years in data warehousing architectural approaches.
 * 5+ years in big data with the Hadoop ecosystem on Cloudera.
 * Proficiency with Hadoop, Hive, Spark, Python, Scala, and Unix shell scripting.
 * Experience operating big data solutions in production environments.
 * Hands-on experience with Autosys or similar scheduling tools.
 * Sound knowledge of relational databases and large SQL-based systems.
 * Strong understanding of distributed systems and data processing patterns.
 * Experience with query optimization and performance tuning.
 * Ability to evaluate and adopt evolving Hadoop ecosystem tools.
 * Effective collaboration and customer-oriented service delivery.

Preferred Skills:

 * Experience with Agile methodologies and CI/CD practices.
 * Exposure to cloud data services on AWS or Azure.

## Description

* Design, build, and maintain data pipelines using Hadoop, Hive, and Spark.
 * Develop and optimize complex SQL and Spark queries for performance and scalability.
 * Implement production-grade big data solutions on Cloudera platforms.
 * Automate workflows with Autosys and Unix shell scripting.
 * Collaborate in Agile teams to deliver reliable, customer-oriented services.
 * Troubleshoot, benchmark, and resolve performance issues across distributed systems.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Old tools, new tricks](https://www.wearedevelopers.com/videos/1916-old-tools-new-tricks)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Diagnostic Tooling: How to get insights from your .NET services hosted in Kubernetes containers?](https://www.wearedevelopers.com/videos/100188-diagnostic-tooling-how-to-get-insights-from-your-net-services-hosted-in-kubernetes-containers)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)