> Markdown version of [/jobs/ext/1568875-big-data-devops-engineer](https://www.wearedevelopers.com/jobs/ext/1568875-big-data-devops-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data DevOps Engineer - **Company:** Nexify Infosystems LLC - **Location:** Denver, CO, United States - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Audit Trail, Bash Shell, Big Data, Cloud Computing Security, Data Infrastructure, Linux, DevOps, Github, Apache Hadoop, Monitoring of Systems, Identity and Access Management, Python (Programming Language), Performance Tuning, Red Hat Enterprise Linux, Ansible, Prometheus, Cloudera, Shell Script, Data Streaming, Transport Layer Security, Google Cloud, Cloud Platform System, System Availability, Grafana, Apache Spark, Infrastructure as Code (IaC), Amazon Virtual Private Cloud (VPC), Git, Cloudformation, Containerization, Gitlab-ci, Kubernetes, Infrastructure Automation Frameworks, Information Technology, AWS Glue, Apache Kafka, CruiseControl, Cloudwatch, Terraform, Splunk, Software Version Control, Docker, Jenkins - **Published:** July 21, 2026 - **Apply:** https://www.dice.com/job-detail/279b1a20-426d-4bec-a7d7-243332cacfa8 ## About the Role * Apache Kafka Administration * AWS Cloud Services * Linux (RHEL/Rocky Linux) * Shell Scripting and Python * Jenkins, Git, Ansible, Terraform * Docker and Kubernetes * Monitoring Tools (Grafana, Prometheus, Splunk) * Networking, Security, and High Availability Concepts * Performance Tuning and Capacity Planning Preferred Qualifications * Bachelor's degree in Computer Science, Information Technology, or related field. * Experience with Cloudera CDP, AWS MSK, Airflow, and Spark. * AWS, Google Cloud Platform, Kafka, or Kubernetes certifications. ## Description Experienced Big Data Administrator responsible for managing, supporting, automating, and optimizing enterprise-scale Hadoop, Kafka, AWS cloud, and DevOps platforms. The role focuses on ensuring high availability, performance, security, scalability, and operational excellence across big data ecosystems while collaborating with development, architecture, and business teams., Kafka Administration * Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments. * Monitor broker health, partitions, replication factors, and consumer lag. * Perform capacity planning and cluster scaling activities. * Manage Kafka security using SSL, SASL, ACLs, and encryption standards. * Troubleshoot producer, consumer, and broker performance issues. * Support Kafka Connect, Schema Registry, Cruise Control, and MirrorMaker implementations. AWS Cloud Administration * Manage cloud infrastructure services including EC2, S3, IAM, VPC, EBS, CloudWatch, CloudTrail and AWS Glue. * Support AWS Managed Streaming for Kafka (MSK), EMR, Lambda, and Airflow environments. * Implement cloud security best practices and governance controls. * Perform infrastructure provisioning and automation using Infrastructure as Code (IaC). * Monitor cloud resource utilization and optimize operational costs. DevOps & Automation * Design and maintain CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools. * Automate infrastructure deployment using Terraform, CloudFormation, and Ansible. * Manage source control repositories and release processes. * Implement monitoring and alerting solutions using Prometheus, Grafana, Splunk, ELK, or CloudWatch. * Support containerization technologies such as Docker and Kubernetes. * Develop automation scripts using Python, Shell, or Bash. Operations & Support * Provide Level 2 and Level 3 production support. * Participate in on-call support rotations and incident management activities. * Perform root cause analysis (RCA) and implement preventive measures. * Create and maintain operational documentation and standard operating procedures. * Ensure compliance with security, audit, and regulatory requirements., * Experience supporting large-scale production environments handling petabyte-scale data workloads. Key Achievements Expected * Maintain platform availability above 99.9%. * Adopt AI-assisted engineering practices to improve operational efficiency, reduce manual effort, and accelerate troubleshooting and documentation. * Automate repetitive operational tasks. * Improve cluster performance and resource utilization. * Ensure secure, scalable, and reliable data platform operations. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [DevOps Engineer Salary [2023]](https://www.wearedevelopers.com/magazine/203-devops-engineer-salary-2023) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)