> Markdown version of [/jobs/ext/2549326-data-platform-infrastructure-engineer-data-engineer](https://www.wearedevelopers.com/jobs/ext/2549326-data-platform-infrastructure-engineer-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Platform Infrastructure Engineer/ Data Engineer

- **Company:** RIVAGO INFOTECH INC.
- **Location:** Scottsdale, AZ, United States
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Configuration Management, Computer Networks, Data Systems, DevOps, Distributed Data Store, Distributed Systems, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Identity and Access Management, Performance Tuning, Ansible, Cloudera, Cloud Platform System, Apache Yarn, System Availability, Apache Spark, Reliability of Systems, Electronic Medical Records, Amazon Virtual Private Cloud (VPC), Containerization, Kubernetes, Infrastructure Automation Frameworks, Apache Kafka, Data Management, Terraform, Data Pipelines, Docker, Databricks
- **Published:** August 6, 2026
- **Apply:** https://www.dice.com/job-detail/bf21f525-e241-4605-bfa2-f1c4bec1316b

## About the Role

* Strong experience in Cloudera (CDH/CDP) cluster setup and administration
 * Hands-on experience with Databricks (cluster management, jobs, notebooks)
 * Strong exposure to AWS (EC2, S3, IAM, VPC, EMR, networking concepts)

Infrastructure & Automation

 * Expertise in Terraform (mandatory) for infrastructure provisioning
 * Proficiency in Ansible for configuration management and automation
 * Experience with CI/CD pipelines for infrastructure deployments

Cluster & Data Technologies

 * Experience managing distributed systems / cluster technologies
 * Strong understanding of:

 * Hadoop ecosystem (HDFS, Hive, Spark, Kafka, etc.)
 * Spark performance tuning and cluster optimization

Knowledge of containerization (Docker/Kubernetes) is a plus

## Description

* Design, deploy, and manage data platform infrastructure across on-prem (Cloudera) and cloud (AWS, Databricks) environments
 * Build and maintain distributed data clusters ensuring high availability, scalability, and performance
 * Automate infrastructure provisioning using Terraform and Ansible
 * Manage and optimize Cloudera Hadoop ecosystems (HDFS, Hive, Spark, YARN, etc.)
 * Deploy and manage Databricks workspaces, clusters, and integrations on AWS
 * Implement infrastructure-as-code (IaC) and configuration management best practices
 * Monitor cluster performance, troubleshoot issues, and ensure system reliability
 * Collaborate with data engineers, architects, and DevOps teams to support data pipelines and analytics workloads
 * Ensure security, compliance, and governance across data platforms
 * Support migration from on-prem to cloud-based data platforms


## Related Videos

- [Dev & Test in the Cloud? Deploy your cloud environments with Ansible & Terraform](https://www.wearedevelopers.com/videos/1607-dev-test-in-the-cloud-deploy-your-cloud-environments-with-ansible-terraform)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey)
- [Industrializing your Data Science capabilities](https://www.wearedevelopers.com/videos/178-industrializing-your-data-science-capabilities)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)