Senior Big Data / AWS Administrator @St. Louis, MO

Diverse Lynx LLC
St. Louis, MO, United States
16 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
0 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Big Data Cloud Computing Databases Data Infrastructure DevOps Disaster Recovery Distributed Systems Fault Tolerance Apache Hadoop
+28 more
Hadoop Distributed File System Apache HBase Apache Hive Identity and Access Management Python (Programming Language) Lynx Performance Tuning Prometheus Data Streaming Enterprise Data Management Data Logging Cloud Platform System Data Ingestion Apache Yarn System Availability Grafana Apache Spark Electronic Medical Records Amazon Virtual Private Cloud (VPC) Cloudformation Low Latency Apache Kafka Virtual Agents Functional Programming Cloudwatch Terraform Stream Processing Confluent

Job description

Cloud & Infrastructure (AWS)

  • Design, deploy, and manage scalable, secure, and highly available infrastructure on AWS.
  • Administer core AWS services: EC2, S3, EMR, EKS, IAM, VPC, CloudWatch, Lambda.
  • Implement automated infrastructure provisioning using Infrastructure as Code (Terraform/CloudFormation).
  • Optimize cost, performance, and reliability of cloud environments.
  • Develop disaster recovery and backup strategies.

Big Data Platform Administration (Hadoop)

  • Install, configure, tune, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark).
  • Monitor cluster health, performance, and capacity planning.
  • Troubleshoot cluster issues and ensure high availability using HA configurations (NameNode HA, etc.).
  • Manage data ingestion and processing workflows.

Streaming Platform Administration (Kafka)

  • Install, configure, and manage Apache Kafka clusters.
  • Ensure high throughput, low latency, and fault-tolerant streaming systems.
  • Manage topics, partitions, brokers, and retention policies.
  • Perform Kafka cluster scaling, upgrades, and performance tuning.
  • Implement monitoring using tools like Prometheus, Grafana, or Confluent Control Center.

System Operations & Monitoring

  • Implement monitoring, logging, and alerting for all systems.
  • Conduct root cause analysis and performance tuning.
  • Ensure system security, access controls, and compliance standards.
  • Maintain detailed documentation and operational runbooks.

Automation & DevOps

  • Build CI/CD pipelines for infrastructure and platform deployments.
  • Automate routine administrative tasks using scripting (Python, Shell, etc.).
  • Collaborate with DevOps and engineering teams for platform improvements.

Requirements

We are seeking a highly experienced Senior Big Data / AWS Administrator with 10+ years of hands-on experience in managing large-scale distributed systems. The ideal candidate will have deep expertise in AWS cloud infrastructure, Hadoop ecosystem, and Kafka administration, ensuring high availability, scalability, and performance of enterprise data platforms., * Minimum 10+ years of experience in system administration, with at least 5+ years in big data and cloud environments.

  • Proven experience managing large-scale Hadoop clusters and Kafka environments.
  • Strong hands-on experience with AWS cloud platform.
  • Agentic AI experience

Technical Skills

  • AWS services: AWS Administration, EC2, S3, EMR, IAM, VPC, CloudWatch, Lambda
  • Big Data : Administration, Hadoop, HDFS, Hive, Spark,
  • Kafka Administration

Years of Experience: 14.00 Years of Experience Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company., St. Louis, MO Freedom Technology Solutions Group is seeking a skilled and detail-oriented Database Administrator (DBA) to support the design, implementation, administration, main…

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:57 min

Introduction to the Lynx cross-platform UI framework

Xuan Huang Xuan Huang · World Congress 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:04 min

Visualizing Keycloak performance via standard Grafana troubleshooting dashboards

Alexander Schwartz Alexander Schwartz · World Congress 2025

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

Videos

See all

Related articles

See all