AWS Cloud Data Lake Lead

Diverse Lynx LLC
Cambridge, VT, United States
6 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$136,200.0 - $204,200.0
Working hours
Regular working hours

Tech stack

A/B Testing Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Data Analysis Big Data Code Review Continuous Integration Distributed Systems Python (Programming Language) Lynx Machine Learning
+22 more
Tensorflow Standard Sql SQL Databases Unstructured Data Feature Engineering Data Ingestion Pytorch Apache Spark Model Validation Git Data Lakes Git Flow Scikit Learn Xgboost Performance Monitor AWS Data Analytics Machine Learning Operations Artificial Intelligence Markup Language (AIML) Software Version Control Data Pipelines Docker Databricks

Job description

Leadership Strategy Lead and manage a team of 6 data scientists, ML engineers, and analytics professionals across onshoreoffshore locations, providing technical mentorship and career guidance. Define and drive the data science operations strategy, roadmap, and best practices aligned with business objectives. Partner with senior business stakeholders, product owners, and cross-functional teams to identify high-impact AIML opportunities and translate them into actionable project plans. Establish and govern standards for model development, deployment, monitoring, and responsible AI adoption across the organization.Hands-On Technical Delivery Architect and oversee scalable ML pipelines for data ingestion, feature engineering, model training, validation, and inference on AWS cloud and Databricks. Design and implement AWS Data Lake architectures and big data processing solutions for structured and unstructured data at petabyte scale using Spark, Databricks, and AWS-native services (S3, Lake Formation, EMR, Glue, SageMaker, Redshift, Athena). Lead the deployment of production ML systems including real-time inference APIs, batch prediction pipelines, and model-as-a-service architectures. Drive MLOps maturity CICD for ML, automated model retraining, drift detection, AB testing, and performance monitoring. +Additional GRS Parameter Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Requirements

AWS Cloud Data Lake (Expert) Deep hands-on experience with AWS services SageMaker, S3, EMR, Glue, Lambda, Redshift, Athena, Step Functions, Lake Formation, and IAMsecurity best practices. Proven experience designing and managing AWS Data Lake architectures. Databricks (Expert) Proficiency in Databricks for large-scale data engineering, ML model development, MLflow for experiment tracking, and Unity Catalog for governance. Big Data Processing (Expert) Strong experience with Apache Spark (PySparkScala), distributed computing, and processing large-scale structuredunstructured datasets. Machine Learning Solid expertise in ML algorithms, feature engineering, model evaluation, and frameworks such as scikit-learn, XGBoost, TensorFlow, or PyTorch. MLOps Proven experience with end-to-end ML lifecycle model deployment, monitoring, retraining, CICD pipelines, containerization (Docker), and orchestration (KubernetesECS). Python Expert-level proficiency for end-to-end data science and ML workflows. SQL Advanced SQL for data analysis and pipeline development. Code Management Proficiency with Git, branching strategies, and code review practices.

Benefits & conditions

  • $136,200-204,200 per year The Salesforce Lead is part of our Fuels Marketing department and serves as the embedded bridge between the commercial organization and IT, ensuring Salesforce and related tools di…

  • 28 days ago +

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:57 min

Introduction to the Lynx cross-platform UI framework

Xuan Huang Xuan Huang · World Congress 2025

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:43 min

AWS infrastructure stack and data flow pipeline overview

Artem Volk Artem Volk +1 · World Congress 2024

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

3:37 min

Balancing scale and velocity with platform adjacency theory

Xuan Huang Xuan Huang · World Congress 2025

Videos

See all

Related articles

See all