> Markdown version of [/jobs/ext/3062537-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3062537-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** General Motors - **Location:** Austin, TX, United States - **Experience:** Expert - **Salary:** $125,000.0 - $191,500.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Geographic Information Systems, Application Programming Interfaces (APIs), Artificial Intelligence, Data Analysis, Application Performance Management, Automation of Tests, Microsoft Azure, Cloud Computing, Code Review, Information Systems, Computer Engineering, Continuous Delivery, Continuous Integration, Information Engineering, Data Security, Data Structures, DevOps, Distributed Computing Environment, Distributed Systems, Github, JSON, Python (Programming Language), Key Management, Machine Learning, Metadata Repositories, NumPy, Octopus Deploy, Object-Oriented Software Development, Operational Databases, Performance Tuning, Reliability Engineering, Cloud Services, Prometheus, DataOps, Search Technologies, Software Engineering, SQL Databases, Data Streaming, Privacy Controls, Azure Service Bus, Datadog, Data Processing, Azure Data Factory, Cloud Monitoring, Pytorch, Retrieval-Augmented Generation, Large Language Models, Grafana, Multi-Agent Systems, Prompt Engineering, Apache Spark, Model Validation, Generative AI, Pandas, Event Driven Architecture, Containerization, Data Lakes, Scikit Learn, Integration Tests, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Apache Flink, Apache Kafka, Azure AKS, Graphql, Data Management, Machine Learning Operations, Video Streaming, Restful APIs, Terraform, Grpc, Data Pipelines, Dynatrace, Databricks - **Published:** September 25, 2026 - **Apply:** https://dejobs.org/x/x/017B1D79256E403E8A2DB3897A24D14D/job/ ## About the Role * Bachelor's degree in computer science, computer engineering, data engineering, information systems, or a related technical field, or equivalent experience. * 5+ years of professional experience in data engineering, software engineering, distributed systems, or a related field. * Strong hands-on experience with Java or Python, SQL, object-oriented design, data structures, algorithms, and automated testing. * Experience designing and operating production data pipelines using Apache Flink, Apache Spark, Kafka, Azure Event Hubs, or comparable streaming technologies. * Experience with cloud-native development on Microsoft Azure and containerized workloads running on Kubernetes. * Experience with Databricks, Delta Lake, distributed data processing, data modeling, and performance optimization. * Experience designing APIs and event-driven systems using GraphQL, REST, gRPC, asynchronous HTTP clients, or equivalent technologies. * Experience with schema evolution, data contracts, data-quality validation, lineage, observability, and privacy-aware data handling. * Demonstrated experience applying machine learning, artificial intelligence, or generative artificial intelligence in a production engineering, analytics, or data-product environment. * Working knowledge of large language models, embeddings, vector databases or vector search, retrieval-augmented generation, prompt design, model evaluation, and responsible artificial intelligence practices. * Ability to troubleshoot complex distributed systems and communicate technical decisions clearly to both technical and nontechnical audiences. * Ability to work effectively in a collaborative, agile, cross-functional environment. What Can Give You a Competitive Advantage (Preferred Qualifications) * Master's degree in computer science, data science, artificial intelligence, machine learning, or a related field. * Experience building multi-agent or agentic systems for data analysis, data operations, engineering support, or customer-facing insights. * Experience with Databricks artificial intelligence and machine learning capabilities, MLflow, model registries, feature stores, vector search, or model-serving platforms. * Experience designing retrieval-augmented generation systems, including chunking, embedding strategies, hybrid retrieval, reranking, grounding, citation, offline evaluation, online evaluation, and hallucination mitigation. * Experience applying generative artificial intelligence to data observability, incident summarization, root-cause analysis, schema mapping, documentation generation, or pipeline remediation. * Experience with time-series data, vehicle telemetry, geospatial data, diagnostics, predictive maintenance, anomaly detection, or other high-volume sensor data. * Experience with Azure OpenAI Service or comparable large language model platforms and with securing enterprise AI workloads. * Experience with Python data and machine-learning libraries such as pandas, NumPy, scikit-learn, PyTorch, or equivalent tools. * Experience with Terraform, Helm, Argo CD, GitHub Actions, Azure DevOps, or comparable DevOps platforms. * Experience with OpenTelemetry, Datadog, Grafana, Prometheus, distributed tracing, service-level objectives, and production reliability engineering. * Knowledge of data catalogs, governance platforms, consent management, privacy engineering, and regional data-retention requirements. * Strong technical leadership, mentoring, influencing, documentation, and cross-functional communication skills. * Demonstrated initiative, sound judgment, accountability, curiosity, and ability to simplify complex problems. ## Description This role is categorized as hybrid. This means the successful candidate is expected to report to Austin Technical Center three times per week, at minimum [or other frequency dictated by the business if more than 3 days]., Vehicle Data Engineering is looking for a Senior Data Engineer to design, build, and operate data products that transform connected-vehicle signals into trusted insights, health information, and proactive customer experiences. This role will work across real-time streaming, cloud data platforms, APIs, analytics, and artificial intelligence to deliver secure, reliable, and explainable data capabilities at scale. The ideal candidate is a hands-on technical leader who can move from architecture to production implementation, improve engineering standards, and partner effectively with product, software, vehicle, cloud, analytics, and data-governance teams. What You'll Do * Design and develop production-grade batch and real-time data pipelines for connected-vehicle telemetry, trip and session data, diagnostic signals, and vehicle-health indicators. * Build streaming applications that ingest, enrich, validate, deduplicate, curate, and publish event-driven data for downstream services, notifications, reporting, and analytics. * Develop reliable data products using Apache Flink, Apache Spark Structured Streaming, Java, Python, and SQL. * Work with Azure services including Azure Kubernetes Service, Event Hubs, Azure Data Explorer, Azure Key Vault, Azure Databricks, Azure Monitor, and Application Insights. * Design and maintain data contracts, schemas, APIs, and event models using GraphQL, REST, gRPC, JSON, and cloud-event patterns. * Apply artificial intelligence and machine learning to data engineering problems such as anomaly detection, data-quality triage, predictive health signals, intelligent operations, and engineering productivity. * Build or integrate generative artificial intelligence capabilities, including large language model applications, embeddings, vector search, retrieval-augmented generation, agentic workflows, prompt engineering, evaluation, and safety guardrails. * Create automated tests, performance benchmarks, integration tests, and validation checks for high-volume data and event-driven systems. * Establish observability with OpenTelemetry, Datadog, Grafana, Prometheus, dashboards, monitors, service-level objectives, and actionable alerts. * Secure data in transit and at rest and apply privacy, consent, retention, lineage, access-control, and regional compliance requirements to vehicle and location data. * Automate infrastructure and delivery using Kubernetes, Helm, Argo CD, Terraform, continuous integration, continuous delivery, and infrastructure-as-code practices. * Participate in architecture reviews, code reviews, incident response, root-cause analysis, operational readiness, and on-call support as needed. * Mentor engineers, raise technical standards, document design decisions, and contribute to a culture of quality, ownership, and continuous improvement. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Exploring the Power of gRPC-Gateway for Writing RESTful Services](https://www.wearedevelopers.com/videos/2072-exploring-the-power-of-grpc-gateway-for-writing-restful-services) - [Boosting OpenSearch Performance: gRPC Search in Action](https://www.wearedevelopers.com/videos/1964-boosting-opensearch-performance-grpc-search-in-action) - [Boosting OpenSearch Performance: gRPC Search in Action](https://www.wearedevelopers.com/videos/1935-boosting-opensearch-performance-grpc-search-in-action) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)