> Markdown version of [/jobs/ext/3457862-senior-staff-engineer-data-and-ai-platform](https://www.wearedevelopers.com/jobs/ext/3457862-senior-staff-engineer-data-and-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Staff Engineer-Data and AI Platform - **Company:** H. E. Butt Grocery Company - **Location:** Austin, TX, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Apache HTTP Server, BigQuery, Cloud Computing, Cloud Storage, Databases, Continuous Integration, Data Architecture, Data Validation, Distributed Systems, Data Flow Control, Monitoring of Systems, Python (Programming Language), Machine Learning, Role-Based Access Control, Cloudera, SQL Databases, Data Streaming, Enterprise Data Management, Google Cloud, Cloud Platform System, Large Language Models, Apache Spark, Deep Learning, Model Validation, Generative AI, Infrastructure as Code (IaC), Data Lakes, AI Platforms, Kubernetes, Information Technology, Machine Learning Operations, Presto, Cloud Migration, Virtual Agents, Terraform, Data Pipelines, Databricks - **Published:** September 10, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=5b05e72411799efd ## About the Role * 10+ years of software, data, or platform engineering experience, including 3+ years at the Staff or Senior Staff level. * Proven success leading large-scale cloud and enterprise data platform migrations. * Deep expertise in GCP, including BigQuery, Dataflow, Dataproc, Airflow/Composer, Pub/Sub, and GCS. * Strong experience with Terraform, Kubernetes, and cloud-native infrastructure. * Hands-on experience building production AI/ML and MLOps platforms using Vertex AI, Kubeflow, MLflow, Feature Stores, and related technologies. * Knowledge of GenAI, LLMOps, vector databases, RAG, model monitoring, and AI governance. * Expert proficiency in Python, SQL, Spark, Trino/Presto, and dbt. * Strong background in distributed systems, data architecture, data modeling, and platform engineering. * Experience implementing enterprise security, governance, RBAC/ABAC, lineage, auditing, and compliance frameworks. * Exceptional communication, technical leadership, and stakeholder management skills., * Experience with AWS, Databricks, Delta Lake, and Apache Iceberg. * Experience delivering enterprise-scale cloud modernization and platform transformation initiatives. * Hands-on experience with production Generative AI, LLM, RAG, and AI Agent solutions. * Background in retail, supply chain, e-commerce, or other large-scale digital organizations. * Experience building self-service data and AI platforms and mentoring senior engineering talent. The responsibilities and essential functions outlined above describe the general nature and level of work assigned to this position. This is not an exhaustive list of all duties, responsibilities, and skills required. Duties and responsibilities may be modified at any time based on business needs. Employees may be required to perform other job-related tasks as requested by their supervisor, subject to reasonable accommodations. Education: * Computer Science degree or comparable formal training, certification, or work experience. Physical Demands & Working Conditions: * Travel by car or plane with overnight stays * Work extended hours; sit for extended periods * Work rotating and on-call schedules, as needed ## Description Job Summary: We are seeking an experienced Senior Staff Engineer - Data & AI Platform to architect and lead our enterprise-wide cloud data modernization and unified AI Platform strategy. In this pivotal technical leadership role, you will spearhead the migration of our data estate from AWS and Databricks to Google Cloud Platform (GCP). You will design and establish standardized ingestion, transformation, and data serving frameworks, build robust developer automation tooling, and lead the architecture of our next-generation enterprise AI and MLOps platform., 1. Cloud Migration & Modernization Strategy * Architect and lead the end-to-end migration of enterprise data workloads and storage from AWS and Databricks to a centralized, modernized GCP ecosystem. * Establish dual-run strategies, data validation frameworks, and zero-downtime cutover methodologies to ensure business continuity. * Design multi-tenant, secure, and cost-optimized cloud architectures leveraging BigQuery, Dataflow, Dataproc, and Cloud Storage. 2. Standardized Enterprise Data Frameworks * Design, build, and evangelize reusable, metadata-driven ingestion, transformation, and serving frameworks. * Standardize pipeline development with built-in data quality, lineage, automated schema evolution, and enterprise RBAC/governance. * Create high-performance batch and real-time streaming architectures supporting mission-critical analytics and operational workloads. 3. Developer Experience (DevX) & Automation Tooling * Build self-service SDKs, templates, and CLI tools that abstract cloud infrastructure complexities for platform consumers (DEs, BIs, DSs). * Drive CI/CD automation and Infrastructure as Code (IaC) best practices to accelerate time-to-delivery for data and machine learning products. * Enhance observability, monitoring, alerting, and cost-governance tooling across all data pipelines and AI workloads. 4. AI Platform & MLOps Infrastructure * Architect and scale enterprise AI and MLOps platforms spanning traditional ML, Deep Learning, and Generative AI (LLMs). * Implement robust model lifecycle infrastructure including feature stores, model registries, automated CI/CD for ML pipelines, and real-time/batch inference engines. * Standardize LLMOps foundations, including vector database integration, retrieval-augmented generation (RAG) frameworks, model evaluation pipelines, and fine-tuning infrastructure. 5. Technical Leadership, Governance & Mentorship * Set technical direction, architectural standards, and engineering guardrails across data and AI engineering teams. * Mentor senior and staff engineers, fostering technical excellence, innovation, and cross-functional collaboration. * Partner with Product, Security, Compliance, and Business Leadership to align platform roadmap priorities with core business outcomes. ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)