> Markdown version of [/jobs/ext/1899536-architect-databricks](https://www.wearedevelopers.com/jobs/ext/1899536-architect-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Architect, Databricks - **Company:** WEST Inc - **Location:** Los Angeles, CA, United States - **Experience:** Expert - **Salary:** $183,800.0 - $212,800.0 - **Contract:** Permanent contract - **Skills:** Unity 3d, Artificial Intelligence, Business Analytics Applications, Data Analysis, Apache HTTP Server, Automated Storage and Retrieval Systems, Microsoft Azure, Big Data, Cloud Computing, Code Review, Computer Programming, Data Architecture, Data Integrity, Data Structures, Information Retrieval, Machine Learning, Performance Tuning, Cloud Services, Requirements Management, Scala (Programming Language), Software Engineering, Sqoop, Data Streaming, Workflow Management Systems, Feature Engineering, Large Language Models, Multi-Agent Systems, Prompt Engineering, Apache Spark, Generative AI, Data Layers, Data Lakes, Apache Flume, Data Management, Machine Learning Operations, Data Pipelines, Cisco, Databricks - **Published:** July 31, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-architect-databricks-los-angeles-ca--483f75c3-a01d-4212-9a36-9e0b7132f55c ## About the Role * 10+ years of professional experience and 3+ years of expeirence with Databricks * 8+ years of prior consulting experience * Very strong technical expertise in Databricks, including architecture, performance optimization, Delta Lake, Unity Catalog, workflow orchestration, security, governance, and cloud-native data engineering best practices * Experience architecting and deploying AI/ML or Generative AI solutions within enterprise environments * Hands-on experience with LLM ecosystems and frameworks such as OpenAI, Azure OpenAI, LangChain, Semantic Kernel, MLflow, or Databricks Mosaic AI * Knowledge of Retrieval-Augmented Generation (RAG), vector databases, embeddings, prompt engineering, and AI orchestration patterns * Familiarity with AI governance, model lifecycle management, responsible AI principles, and enterprise security considerations * Experience integrating AI capabilities into data platforms, analytics solutions, or customer-facing applications * Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment * A commitment to inclusion and diversity, and openness to new ideas and perspectives * Travel requirements up to 30 to 50% * Hybrid role: 1 to 2 days a week in office, Analysis Skills, Apache Spark, Apache Sqoop, Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Best Practices, Big Data, Cisco Unity, Cloud Computing, Coaching, Code Reviews, Consulting, Data Analysis, Data Management, Data Quality, Data Science, Data Structures, Diversity, Ecosystems, Emerging Technology, Enterprise Protection, Financial Services, Geography, Healthcare, Information Retrieval, Insurance, International Business, Kernel Programming, Machine Learning, Machine Tool, Microsoft Windows Azure, Performance Tuning/Optimization, Problem Solving Skills, Production Machining, Regulatory Compliance, Requirements Management, Scala Programming Language, Software Engineering, Strategic Planning, Technical Leadership, Use Cases, Willing to Travel ## Description * Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop * Design data structures for ingestion and reporting, specific to use case and technology * Provide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes * Collaborate with data science and engineering teams to productionize machine learning and Generative AI workloads within modern cloud ecosystems * Establish best practices for AI data readiness, feature engineering, model monitoring, observability, and governance * Lead technical discussions around AI-enabled modernization strategies including semantic layers, vector databases, AI agents, and knowledge retrieval systems * Evaluate emerging AI technologies and recommend fit-for-purpose tooling aligned to client objectives, scalability, security, and compliance requirements * Guide and coach consultants, share best practices, perform code reviews * Coordinate activities with data source application owners to ensure integration with analytics platform and source systems * Ensure that data integrity issues are addressed * Liaise and attend meetings necessary to perform duties and aid business and technical development ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai) - [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai) - [Computer Vision from the Edge to the Cloud done easy](https://www.wearedevelopers.com/videos/263-computer-vision-from-the-edge-to-the-cloud-done-easy) ## Related Articles - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)