Big Data / AWS Administrator

Here Technologies
St. Louis, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

St. Louis, United States of America

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Cloud Computing
Data Infrastructure
DevOps
Disaster Recovery
Distributed Systems
Fault Tolerance
Hadoop
Hadoop Distributed File System
HBase
Hive
Identity and Access Management
Python
Performance Tuning
Prometheus
Data Streaming
Enterprise Data Management
Data Logging
Cloud Platform System
Data Ingestion
Apache Yarn
System Availability
Grafana
Spark
Electronic Medical Records
Amazon Web Services (AWS)
Cloudformation
Low Latency
Kafka
Virtual Agents
Functional Programming
Cloudwatch
Terraform
Stream Processing
Confluent

Job description

Cloud & Infrastructure (AWS)

  • Design, deploy, and manage scalable, secure, and highly available infrastructure on AWS.
  • Administer core AWS services: EC2, S3, EMR, EKS, IAM, VPC, CloudWatch, Lambda.
  • Implement automated infrastructure provisioning using Infrastructure as Code (Terraform/CloudFormation).
  • Optimize cost, performance, and reliability of cloud environments.
  • Develop disaster recovery and backup strategies.

Big Data Platform Administration (Hadoop)

  • Install, configure, tune, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark).
  • Monitor cluster health, performance, and capacity planning.
  • Troubleshoot cluster issues and ensure high availability using HA configurations (NameNode HA, etc.).
  • Manage data ingestion and processing workflows.

Streaming Platform Administration (Kafka)

  • Install, configure, and manage Apache Kafka clusters.
  • Ensure high throughput, low latency, and fault-tolerant streaming systems.
  • Manage topics, partitions, brokers, and retention policies.
  • Perform Kafka cluster scaling, upgrades, and performance tuning.
  • Implement monitoring using tools like Prometheus, Grafana, or Confluent Control Center.

System Operations & Monitoring

  • Implement monitoring, logging, and alerting for all systems.
  • Conduct root cause analysis and performance tuning.
  • Ensure system security, access controls, and compliance standards.
  • Maintain detailed documentation and operational runbooks.

Automation & DevOps

  • Build CI/CD pipelines for infrastructure and platform deployments.
  • Automate routine administrative tasks using scripting (Python, Shell, etc.).
  • Collaborate with DevOps and engineering teams for platform improvements.

Requirements

We are seeking a highly experienced Senior Big Data / AWS Administrator with 10+ years of hands-on experience in managing large-scale distributed systems. The ideal candidate will have deep expertise in AWS cloud infrastructure, Hadoop ecosystem, and Kafka administration, ensuring high availability, scalability, and performance of enterprise data platforms., * Minimum 10+ years of experience in system administration, with at least 5+ years in big data and cloud environments.

  • Proven experience managing large-scale Hadoop clusters and Kafka environments.
  • Strong hands-on experience with AWS cloud platform.
  • Agentic AI experience

Technical Skills

  • AWS services: AWS Administration, EC2, S3, EMR, IAM, VPC, CloudWatch, Lambda
  • Big Data : Administration, Hadoop, HDFS, Hive, Spark,
  • Kafka Administration

Apply for this position