Senior Data Engineer | Spark Expert

Keysight Technologies
Barcelona, Spain
8 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Engineering Databases Continuous Integration Data Architecture Data Discovery Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL)
+29 more
Data Security Data Structures Apache Hadoop Statistical Hypothesis Testing Python (Programming Language) Machine Learning Meta-Data Management NoSQL Power BI SQL Databases Tableau (Software) Unstructured Data Data Processing Feature Engineering 5G NR Snowflake Apache Spark Deep Learning Containerization Data Lakes Kubernetes Plotly Apache Kafka Operational Systems Data Management Machine Learning Operations Data Pipelines Docker Databricks

Job description

Keysight is on the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization.Our ~15,000 employees create world-class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over 100 countries.Our award-winning culture embraces a bold vision of where technology can take us and a passion for tackling challenging problems with industry-first solutions.About Keysight AI Labs Keysight’s AI Labs is a global R&D group pioneering the integration of machine learning, generative AI into Keysight’s test, measurement, and design solutions.Our mission is to transform how engineers design, simulate, and validate advanced systems- from 6G and semiconductors to quantum and automotive - by embedding AI throughout our workflows.As part of this growing team, you will join a vibrant, cross-functional environment that brings together experts in ML engineering, data science, physics-informed modeling, and software development.You’ll work closely with domain experts across RF, EM, circuit design, and test & measurement to accelerate scientific innovation through AI.About the Role We are seeking a Senior Applied Data Scientist with strong data engineering capabilities.You will explore complex engineering data, architect scalable data infrastructure, and shape the data foundation powering AI model development across Keysight products.This role bridges research and production, from data discovery to robust ETL/ELT pipeline design and feature creation for ML models.Responsibilities Partner with internal experts to identify critical data sources and define ML-relevant features Architect and build scalable data lakes/databases for standardized and efficient cross-org data access Clean, align, normalize, and integrate data from simulations, measurements, and operational systems Develop and maintain reproducible ETL/ELT pipelines for structured and unstructured data using SQL, Python, Snowflake, and cloud-native workflows Perform EDA, feature engineering, regression, and dimensionality reduction to generate high-value insights Ensure data governance, lineage, metadata management, and compliance Support experiment design, hypothesis testing, and statistical modeling Work closely with ML engineers to accelerate model training, deployment, and ongoing monitoring Required Qualifications Master’s in Data Science, Statistics, CS, EE, or related quantitative field 5+ years of experience as an applied data scientist or hybrid DS/DE role Expert proficiency in Python, SQL, and data manipulation libraries Strong background in statistics, algorithms, and data structures Experience with relational + NoSQL databases and designing scalable data architectures Hands-on experience with big data tools (e.g., Spark, Kafka, Snowflake, Databricks, Hadoop ) Experience supporting ML workflows - MLOps, CI/CD, containerization (Docker/Kubernetes) Experience with cloud platforms: Azure / AWS / GCP Clear track record of driving data-to-value outcomes wireless, electronics, semiconductor) Familiarity with deep learning frameworks and ML for time-series or unstructured data Power BI, Tableau, Plotly) Knowledge of data governance, lineage, metadata management tools

Requirements

Responsibilities Partner with internal experts to identify critical data sources and define ML-relevant features Architect and build scalable data lakes/databases for standardized and efficient cross-org data access Clean, align, normalize, and integrate data from simulations, measurements, and operational systems Develop and maintain reproducible ETL/ELT pipelines for structured and unstructured data using SQL, Python, Snowflake, and cloud-native workflows Perform EDA, feature engineering, regression, and dimensionality reduction to generate high-value insights Ensure data governance, lineage, metadata management, and compliance Support experiment design, hypothesis testing, and statistical modeling Work closely with ML engineers to accelerate model training, deployment, and ongoing monitoring Required Qualifications Master’s in Data Science, Statistics, CS, EE, or related quantitative field 5+ years of experience as an applied data scientist or hybrid DS/DE role Expert proficiency in Python, SQL, and data manipulation libraries Strong background in statistics, algorithms, and data structures Experience with relational + NoSQL databases and designing scalable data architectures Hands-on experience with big data tools (e.g., Spark, Kafka, Snowflake, Databricks, Hadoop ) Experience supporting ML workflows - MLOps, CI/CD, containerization (Docker/Kubernetes) Experience with cloud platforms: Azure / AWS / GCP Clear track record of driving data-to-value outcomes wireless, electronics, semiconductor) Familiarity with deep learning frameworks and ML for time-series or unstructured data Power BI, Tableau, Plotly) Knowledge of data governance, lineage, metadata management tools

About the company

Barcelona, España

Keysight is on the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization. Our ~15,000 employees create world-class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over 100 countries. Our award-winning culture embraces a bold vision of where technology can take us and a passion for tackling challenging problems with industry-first solutions. About Keysight AI Labs Keysight’s AI Labs is a global R&D group pioneering the integration of machine learning, generative AI into Keysight’s test, measurement, and design solutions. Our mission is to transform how engineers design, simulate, and validate advanced systems- from 6G and semiconductors to quantum and automotive - by embedding AI throughout our workflows. As part of this growing team, you will join a vibrant, cross-functional environment that brings together experts in ML engineering, data science, physics-informed modeling, and software development. You’ll work closely with domain experts across RF, EM, circuit design, and test & measurement to accelerate scientific innovation through AI.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all