Staff Data Engineer - Testable Functionality Rollout Plan
Role details
Job location
Tech stack
Job description
Hybrid: This role is categorized as hybrid. This means the successful candidate is expected to report to Milford, Michigan or Warren, Michigan three times per week, at minimum., * Develop and maintain backend APIs/services in Python (e.g., Flask/FastAPI) that provide structured access to processed test data and failure summaries.
- Code and provide requirements for scalable UI & reporting initiatives utilizing React web application and both relational and graph database capabilities.
- Integrate with upstream systems (test infrastructure, CI pipelines, file/object storage) and downstream consumers (internal web apps, reporting tools).
- Implement robust error handling, logging, metrics, and tracing so incidents are visible and diagnosable without guesswork.
Support analytics & reporting
- Partner with data analysts and engineering stakeholders to shape the semantic layer (tables, views, measures) that powers Power BI and other reporting tools.
- Ensure nightly refreshes are predictable, well-monitored, and clearly communicated to stakeholders.
- Help simplify complex test/log data into intuitive, stable data models that engineers can easily query and build on.
Technical leadership & mentoring
- Serve as the technical point of contact for the automated test analytics platform and its nightly processing - including incident response and root-cause analysis.
- Drive engineering standards for code quality, testing, documentation, and reviews across data and backend components.
- Mentor engineers and analysts on Databricks, data modeling, and backend best practices, enabling the broader team to contribute safely and effectively.
- Provide requirements, documentation, training videos, training classes, and message board technical support and RCA.
- Provide Support for users on technical support on dashboard related issues.
- Model and foster GM's Core Values and Winning behaviors
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Data Engineering, Engineering, or a related field.
- 7+ years of professional experience in software and/or data engineering.
- Strong hands-on experience with Databricks or similar Spark-based platforms, including:
- Building production ETL/ELT pipelines in PySpark.
- Working with Delta Lake (or equivalent) for large-scale data storage and querying.
- Proficiency in Python for both data processing and backend service development.
- Proficiency in React web stack and typescript.
- Strong SQL and data modeling skills; experience designing schemas and tuning queries for performance at scale.
- Experience building and operating backend services/APIs (e.g., Flask, FastAPI, Django, or similar).
- Proven track record of owning critical batch or nightly pipelines, including monitoring, alerting, and incident management.
- Strong communication skills and ability to work directly with cross-functional partners (engineers, analysts, product leads).
What Will Give You A Competitive Edge (Preferred Qualifications):
- Master's degree in Computer Science, Software Engineering, Data Engineering, Engineering, or a related field.
- 10+ years of professional experience in software and/or data engineering.
- Strong skills connecting end user UI with application integration and data source schema alignment.
- SQL Power user with additional experience in graph database querying (cypher/ graphQL) and neo4j.
- Deep experience with Databricks deployment tooling (e.g., dbx), CI/CD pipelines, and multi-environment management.
- Prior work with automated test infrastructures, CI/CD systems, or large-scale log/telemetry processing.
- Strong experience with Power BI (or similar BI tools), including data modeling, DAX, and performance optimization.
- Familiarity with Microsoft Azure (e.g., Data Lake, Key Vault, Data Factory, Event Hubs/Service Bus).
- Background in automotive, embedded systems, diagnostics, or other safety-critical domains where test quality and rapid root-cause analysis are essential.
Company Vehicle:
Upon successful completion of a motor vehicle report review, you will be eligible to participate in a company vehicle evaluation program, through which you will be assigned a General Motors vehicle to drive and evaluate. Note: program participants are required to purchase/lease a qualifying GM vehicle every four years unless one of a limited number of exceptions applies.
Benefits & conditions
GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.