> Markdown version of [/jobs/ext/1498562-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1498562-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Adobe Inc. - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Salary:** $163,200.0 - $236,400.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Microsoft Azure, Computer Engineering, Data Architecture, Information Engineering, Extract Transform Load (ETL), Python (Programming Language), SQL Databases, Data Logging, Large Language Models, Multi-Agent Systems, Generative AI, Adobe, Pyspark, Information Technology, Low Latency, Data Analytics, Tools for Reporting, Application Client, Data Pipelines, Databricks - **Published:** July 30, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/17745068?backUrl=%2Fcareer%2F17745068%2FSenior-Data-Engineer-California-San-Francisco ## About the Role * Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. * Proficiency in SQL and Python, PySpark, Airflow, Databricks workflows. * 5+ years in data engineering, including production pipelines at scale. * Experience with high-volume event/telemetry data from a client application, not just server-side data. * Experience integrating AI tools to optimize/redesign workflows towards higher efficiency, quality, or latency. * Experience building multi-agent AI systems or agentic workflows. * Working knowledge of AI/ML data pipelines (feature stores, embeddings, or retrieval) and modern BI/reporting tools. * A track record of partnering with Product, Engineering, and Data Science to turn ambiguous questions into reliable data models. Preferred Requirements: * MS or Ph.D. in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. * Hands-on experience with Databricks and Unity Catalog (or comparable Lakehouse and governance tooling). * Experience deploying and managing services and applications on Azure and Azure Cloud platforms. * Familiarity with Retrieval Augmented Generation (RAG) techniques working in conjunction with LLMs. * Familiarity with data privacy and compliance for user-behavior data (e.g., GDPR, CCPA). ## Description We are looking for a Senior Data Engineer who will build a strong and scalable foundation to support it. Join us and build Adobe's future products! What you'll Do * Build, scale and optimize the data architecture and ETL/pipeline on Databricks across Pro Design products, spanning shared platform data and in-app usage telemetry. * Partner with Product, Engineering, and Data Science to define and implement data logging and instrumentation that enables product experimentation, AI/ML features, and analytics. * Set and evolve governance standards regarding data quality, privacy, security, lineage, and SLAs in Unity Catalog. * Build automated reporting and the data foundations that power conversational, AI-driven insights across our reporting stack. * Keep production pipelines and queries healthy and performant at scale and drive optimization for cost and latency. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [3x Performance: A Humbling Journey](https://www.wearedevelopers.com/videos/100165-3x-performance-a-humbling-journey) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)