> Markdown version of [/jobs/ext/1469479-staff-ai-data-infrastructure-pipeline-engineer](https://www.wearedevelopers.com/jobs/ext/1469479-staff-ai-data-infrastructure-pipeline-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff AI Data Infrastructure/Pipeline Engineer - **Company:** XPeng Inc. - **Location:** Santa Clara, United States - **Experience:** Expert - **Salary:** $244,140.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Apache HTTP Server, Big Data, Software Quality, Data Cleansing, Data Infrastructure, Extract Transform Load (ETL), Data Mining, Data Retrieval, Data Security, Data Synchronization, Data Visualization, Data Warehousing, Relational Databases, Distributed Computing Environment, Distributed Data Store, Distributed Systems, Memory Management, Github, Python (Programming Language), PostgreSQL, Meta-Data Management, MongoDB, MySQL, NoSQL, Performance Tuning, Queueing Systems, RabbitMQ, Redis, Software Engineering, AI Infrastructure, Feature Engineering, Model Validation, Caching, Data Lakes, Core Data, Kubernetes, Information Technology, Data Lineage, Low Latency, Apache Kafka, Free and Open-Source Software, Data Management, Software Coding, Stream Processing, Software Version Control, Data Pipelines, Docker, Programming Languages - **Published:** July 28, 2026 - **Apply:** https://www.dice.com/job-detail/8e1af1e0-1005-4a70-94c4-8fbd5623b92c ## About the Role * Bachelor's degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or related fields. * 5-8+ years of experience in large-scale data processing or data platform development. * Proficiency in at least one programming language among Python / Go / Java. Solid software engineering foundation, good coding standards, and a strong sense of code quality. * Hands-on project experience in at least two of the following areas: + Design and development of large-scale data pipelines / ETL systems, with end-to-end experience in data cleaning, transformation, and loading. + Production-level experience with distributed message queues (Kafka / Pulsar / RabbitMQ), familiar with stream processing paradigms. + Experience with distributed data lake systems (e.g., Apache Iceberg), familiar with Iceberg's table format, partition evolution, snapshot isolation, etc., with practical performance tuning and deployment experience. + Experience with columnar storage formats (e.g., Lance) and related query engines, with practical application in large model training. * Hands-on experience using and optimizing relational databases (MySQL / PostgreSQL) and NoSQL databases (Redis / MongoDB). Understand metadata management and caching strategies. * Experience in performance optimization and troubleshooting for large-scale distributed systems, able to quickly locate and resolve complex performance bottlenecks. Experience with Kubernetes / Docker containerization deployment. * Strong cross-team communication and collaboration skills, high sense of responsibility, and proactive problem-solving attitude. Preferred Qualifications * Familiarity with closed-loop data in the embodied AI industry will be a huge plus. * Some understanding of the autonomous driving industry, awareness of data closed loop and data flywheel concepts, and enthusiasm for this field. * Experience with AI infrastructure or model training workflows (e.g., data loading, feature engineering, data preparation for model evaluation). * Familiarity with data lake / data warehouse systems, with practical experience implementing data version control and data lineage tracing. * Open-source contributions on GitHub or a technical blog, with continuous attention to the latest technological trends in big data / AI infrastructure. ## Description * Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in quickly locating model error cases and driving iterative model optimization. * Data Support for Production and R&D Processes. This includes log event tracking, connected vehicle data, internal and external data collection, data synchronization, data cleaning and standardization, data modeling, offline and real-time data processing, data as a service, and data visualization. Support business operations such as autonomous driving, smart cockpits, overseas data collection, and robotics data collection. * Responsible for optimizing the performance of the entire data pipeline (collection, cleaning, conversion). Solve bottlenecks in large-scale data transmission, memory management, I/O, etc., and build a distributed data processing system with high throughput and low latency. * Responsible for building a data management platform covering the entire process from data collection to data lake ingestion to model training. Implement capabilities for data version control, data lineage tracing, metadata management, and fast data retrieval to support unified data access and collaboration across multiple teams. * Collaborate with the large model team and other technical teams to deeply understand business requirements, respond quickly, and ensure successful implementation. ## Related Videos - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level) - [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)