Data Operations Engineer

Dexian DISYS
Cupertino, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 114K

Job location

Cupertino, United States of America

Tech stack

Java
Airflow
Data analysis
Databases
Continuous Delivery
Software Debugging
Python
Metadata Repositories
DataOps
Spinnaker
Tableau
Jupyter Notebook
Cloud Platform System
Real Time Systems
Snowflake
Grafana
Spark
HybridCloud
Gitlab
Kubernetes
Apache Flink
Luigi
Cassandra
Data Analytics
Machine Learning Operations
Terraform
Splunk
Api Management
Docker
Databricks
Programming Languages

Job description

  • As data operations engineer, you will collaborate with various infrastructure teams, platforms, product, engineering and scientists, to identify requirements that will derive the creation of sensible operations to build and manage data analytics foundations.
  • The ideal candidate is a self-motivated teammate with good problem solving and communication skills with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible operational decisions., * Lead day-to-day operations to ensure organizational delivery of quality results.
  • Responsible for provisioning, enabling, scaling and maintaining our team's data, analytics and ML infrastructures for batch and real time systems including pipelines, frameworks, tools and services in hybrid cloud.
  • Shepherd zero-downtime deployment process through continuous delivery practices, rapidly releasing features that provide critical and faster insights to business users.
  • Collaborate with the platform team by building the right tools for observability , monitoring, alerting and self-healing for the day to day management of analytics foundations.
  • Debug complex problems in distributed environment and ability to run the prod incidents efficiently to following up with Post incident reviews.
  • Developing self-service tools and automation to improve engineering efficiency and the quality of services.

Requirements

  • Excellent verbal and written communication skills.
  • Self-starter with forward thinking capability with strong executional track record and be accountable for business priorities.
  • Hands-on experience with CI/CD pipelines and cloud environments like Gitlab, Spinnaker, Docker/Kubernetes observability using Splunk, Grafana/Data dog is a huge plus.
  • Proficient with one or more programming languages such as Python/Go/Rust/Java/Scala for automation and API integrations.
  • Experience in implementing security controls, governance processes, compliance validation, infrastructure cost analysis and optimization.
  • Knowledge of analytics and Applied ML stack like Apache Spark, Trino/Pinot, Iceberg, Atlas, Flink, Airflow/Luigi, Tableau, Snowflake, Databricks, MLFlow, Data Catalogs, Jupyter Notebooks, Vector database and Cassandra.
  • Solid understanding of IAAC (infrastructure as a code) techniques like terraform, orchestration and tooling.
  • Experience scaling operations in a fast-paced and dynamic environment. Experience working in agile or evolving product environments.

About the company

Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.

Apply for this position