> Markdown version of [/jobs/ext/2212897-principal-machine-learning-engineer-accelerated-apache-spark](https://www.wearedevelopers.com/jobs/ext/2212897-principal-machine-learning-engineer-accelerated-apache-spark). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Machine Learning Engineer, Accelerated Apache Spark - **Company:** NVIDIA Ltd. - **Location:** Santa Clara, CA, United States (Remote available) - **Experience:** Experienced - **Salary:** $272,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Algorithm Design, Big Data, C++ (Programming Language), Nvidia CUDA, Computer Programming, Data Centers, Extract Transform Load (ETL), Python (Programming Language), Machine Learning, NumPy, Open Source Technology, Tensorflow, SciPy, SQL Databases, Reinforcement Learning, Data Processing, Graphics Processing Unit (GPU), Feature Engineering, Pytorch, Delivery Pipeline, Large Language Models, Apache Spark, Pandas, Scikit Learn, Information Technology, Xgboost, Machine Learning Operations - **Published:** August 24, 2026 - **Apply:** https://arc.dev/remote-jobs/j/redirect/pecgdks8qd ## About the Role * BS, MS, or PhD or equivalent experience in Machine Learning, Data Science, Computer Science or a closely related field. * 12+ years of professional experience in designing, implementing, and productionizing high-quality ML/DL solutions. * 5+ experience as technical lead in ML model development. * Proven hands-on experience (2+ years) with large-scale data processing platforms, such as Apache Spark. * Proven ability to employ modern tooling and sound techniques for all aspects of crafting, deploying, and maintaining machine learning models. * Excellent programming skills in Python and Python data science related libraries like numpy, pandas, scikit-learn, scipy, pytorch, and tensorflow. * Deep experience with sophisticated ML methodologies, including LLM/GenAI, reinforcement learning, and adaptive, on-line ML systems. * Strong expertise in feature engineering, feature importance assessment, and developing boosted tree model solutions (e.g., XGBoost). Ways To Stand Out From The Crowd * Understanding of the internal workings and architecture related to Apache Spark. * Familiarity with NVIDIA GPUs and CUDA. * Experience coding in Scala, Java, and/or C++. NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most experienced and dedicated people in the world working for us. If you are passionate about what you do, creative and autonomous, we want to hear from you! ## Description NVIDIA is looking for a Machine Learning (ML) Engineer to join the GPU accelerated Apache Spark team. Apache Spark is the most popular data processing engine in data centers for running large scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning many domains and use cases. NVIDIA GPUs offer a promising avenue for significantly speeding up and/or lowering the cost of running Apache Spark applications at massive scales. You will work with the open source community to accelerate Apache Spark with GPUs. You will apply the latest ML/AI methods to empower enterprises to migrate Spark workloads onto GPUs at scale. What You'll Be Doing * Design and implement machine learning solutions for performance prediction and optimization of GPU accelerated enterprise Apache Spark workloads. * Develop advanced algorithms and adaptive systems to continuously improve the performance of Apache Spark workloads on GPUs. * Develop AI-based agents and tools to assist with fixing system issues and application optimization. * Collaborate with key partners and customers on the deployment of complex machine learning solutions in various environments. * Maintain deep domain expertise by knowing the latest published advances in ML systems and algorithms. * Provide technical mentorship and leadership in data science and machine learning to a team of engineers. ## Related Videos - [Python Data Visualization @ Deepnote (w/ PyViz overview)](https://www.wearedevelopers.com/videos/113-python-data-visualization-deepnote-w-pyviz-overview) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [Accelerating Python on GPUs](https://www.wearedevelopers.com/videos/859-accelerating-python-on-gpus) - [Accelerating Python on GPUs](https://www.wearedevelopers.com/videos/1112-accelerating-python-on-gpus) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)