> Markdown version of [/jobs/ext/2610177-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/2610177-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Big Data Engineer

- **Company:** Select Minds LLC
- **Location:** Lansing, MI, United States
- **Experience:** Expert
- **Salary:** $110,000.0 - $125,000.0
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Big Data, Continuous Integration, Elasticsearch, Apache Hadoop, Apache Hive, Python (Programming Language), PostgreSQL, Apache Maven, Cisco Nexus Switches, Apache Oozie, Logstash, Ansible, Scala (Programming Language), Shell Script, SonarQube, Apache Spark, Git, Apache Kafka, Apache Nifi, Kibana, Stream Processing, Data Pipelines, Jenkins, Control M
- **Published:** August 4, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=ca295e881951a0b5

## About the Role

* 8+ years of experience in Big Data technologies.
 * Strong hands-on experience with Spark, Scala, Hive (HQL), and the Hadoop ecosystem.
 * Experience implementing Apache NiFi and Apache Kafka.
 * Proficiency in Shell Scripting or Python.
 * Experience with PostgreSQL.
 * Familiarity with scheduling tools such as Oozie and Control-M.
 * Working knowledge of Git, Jenkins, Nexus, Maven, Ansible, and SonarQube.
 * Strong understanding of CI/CD practices.
 * Experience in client-facing roles, including requirement gathering workshops.
 * Minimum of two end-to-end Big Data implementation projects.
 * Ability to work independently and contribute effectively within Agile teams.

## Description

We are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will have strong hands-on expertise in the Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with experience building scalable data pipelines and supporting modern CI/CD practices. Candidates should have worked directly with clients, participated in requirement gathering sessions, and delivered end-to-end Big Data implementations., * Design, develop, and optimize large-scale data processing pipelines using Spark, Scala, and Hive.

 * Build and maintain data ingestion workflows using Apache NiFi.
 * Develop and support real-time data streaming solutions using Apache Kafka.
 * Monitor application logs and system health using Kibana, Elasticsearch, and Logstash.
 * Implement and support CI/CD pipelines using Git, Jenkins, and Nexus.
 * Ensure data quality, integrity, and governance across Big Data platforms.
 * Participate in architecture discussions and recommend scalable design solutions.
 * Troubleshoot and resolve complex production issues across the Big Data stack.
 * Collaborate with cross-functional teams in an Agile environment.
 * Mentor junior engineers and contribute to technical best practices.


## Related Videos

- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Debug a Kubernetes Operator](https://www.wearedevelopers.com/videos/487-debug-a-kubernetes-operator)
- [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)