Big Data Platform Engineer

Symphony Corporation
Austin, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Austin, United States of America

Tech stack

Java
Airflow
Amazon Web Services (AWS)
Big Data
Continuous Integration
Hadoop Distributed File System
Python
Cloud Services
Jupyter Notebook
Datadog
Google Cloud Platform
Cloud Monitoring
Grafana
Spark
Gitlab
Kubernetes
Apache Flink
Data Management
Terraform
Splunk
Api Management
Docker
Programming Languages

Requirements

  • 5+ years of professional experience with large-scale data platform, data product development, and platform operations
  • 2+ years of experience developing and operating infrastructure, data platforms, and cloud services in hybrid environments (On-prem, AWS, or Google Cloud Platform)
  • Hands-on experience with operations automation and observability on HDFS and Objectstores
  • Experience with Jupyter Notebook environment automation and operations
  • Proficient in one or more programming languages (Python, Java, or Scala) for automation, API integrations, and Spark job development
  • Proficient with analytics stack including Apache Spark/Flink, Iceberg, Airflow, and Kubernetes

PREFERRED QUALIFICATIONS

  • Knowledge of CI/CD technologies including GitLab, Terraform, Docker/Kubernetes, and cloud monitoring tools (Splunk, Grafana, Datadog)
  • Experience implementing security controls, governance processes, compliance validation, infrastructure cost analysis, and optimization?

Apply for this position