> Markdown version of [/jobs/ext/2866008-resident-solution-architect](https://www.wearedevelopers.com/jobs/ext/2866008-resident-solution-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Resident Solution Architect - **Company:** JUPITER IT SOLUTIONS LLC - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Business Analytics Applications, Microsoft Azure, Software as a Service, Cloud Computing, Cluster Analysis, Databases, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Warehousing, IBM InfoSphere DataStage, Dimensional Modeling, Greenplum, Apache Hadoop, Identity and Access Management, Machine Learning, Object-Oriented Software Development, Oracle (Applications), Performance Tuning, Standard Sql, Azure Data Lake, SAS (Software), Search Technologies, SQL Databases, Talend, Teradata SQL, Google Cloud, Netezza, Snowflake, Apache Spark, Data Lakes, Pyspark, Collibra, Machine Learning Operations, Virtual Agents, Terraform, Azure Synapse Analytics, Serverless Computing, Legacy Systems, Databricks - **Published:** September 12, 2026 - **Apply:** https://www.dice.com/job-detail/72ebd4ce-0702-4da9-b783-bd8185b05543 ## About the Role * 8+ years in data engineering / data platform architecture, with 3+ years handson on Databricks in a customer-facing or consulting capacity. * Demonstrated experience leading at least 2-3 large- scale EDW modernization or Lakehouse migration programs end to end. * Strong, fundamentals-level understanding of the Databricks Data Intelligence Platform. * Delta Lake internals (transaction log, OPTIMIZE, Z- order, Liquid Clustering, Deletion Vector, Predictive Optimization) * Spark execution model, Photon, cluster sizing, and performance tuning. * Unity Catalog object model (metastore, catalogs, schemas, volumes, external locations, stor age credentials). * Workspace, account, and identity architecture across AWS / Azure / Google Cloud Platform. * Handson experience designing and deploying Lakeflow Declarative Pipelines, Lakeflow Conn ect, and Serverless workloads in production. * Solid grounding in Medallion Architecture, dimensional modeling, and data governance fra meworks. * Strong SQL and PySpark skills; comfort reading and reasoning about Spark execution plans. * Cloud fluency on at least one of Azure, AWS, or Google Cloud Platform including networking, IAM, and storage layers (ADLS Gen2 / S3 / GCS). * Excellent communication and stakeholder management skills able to engage equally with engineers and C- suite. * Willing to travel and stay overseas for Solutioning and Delivering projects., * Databricks certifications: Certified Data Engineer Professional, Certified Machine Learning Pr ofessional, or Databricks Certified Solutions Architect Professional. * Experience with DR architectures (Delta Deep Clone, crossregion replication, RPO/RTO design). * Exposure to MLOps / GenAI patterns on Databricks (MLflow, Model Serving, Vector Search, Mosaic AI Agent Framework) * Familiarity with legacy ETL/ELT platforms (Informatica, ODI, SAS DI, DataStage, Talend) for migration credibility. * Experience with Terraform / Databricks Asset Bundles for IaC and CI/CD. * Working knowledge of Immuta, Collibra, Purview, or Alation for governance integration. * Industry depth in BFSI, Insurance, Retail, Manufacturing, or Healthcare. Preferred Skills * Owned the architecture for at least 2 strategic customer engagements from discovery to golive. * Established yourself as the goto advisor on advanced Databricks adoption (LDP, Lakeflow Co nnect, Serverless) within the practice * Contributed to reusable accelerators, reference architectures, and migration playbooks that scale across the practice. * Built strong working relationships with Databricks field teams and contributed to joint p ursuits. ## Description We are seeking a Senior Solution Architect to join our Databricks Practice and play a pivotal role in shaping data modernization journeys for enterprise customers. This is a customer-facing, consulting-oriented role where you will engage with CDOs, Data Architects, and Engineering leaders to design and deliver scalable, future-ready Lakehouse solutions on the Databricks Data Intelligence Platform. You will be the trusted technical advisor - translating business problems into architectural blueprints, guiding customers through EDW modernization programs, and championing the adoption of Databricks' most advanced capabilities including Lakeflow Declarative Pipelines (LDP), Lakeflow Connect, Serverless Compute, Unity Catalog, and AI/BI workloads. Responsibilities: * Lead pre-sales and delivery architecture conversations with enterprise customers, owning the technical narrative from discovery through solution design and through implementation oversight. * Design end-to-end Databricks Lakehouse architectures spanning ingestion, transformation, governance, ML, and consumption layers - aligned to Medallion Architecture principles. * Drive EDW modernization engagements, including migration strategies from legacy platforms (Teradata, Netezza, Oracle, SAS, Greenplum, Synapse, Snowflake, on-prem Hadoop) to Databricks, with clear wave planning, risk mitigation, and TCO/ROI articulation. * Advise customers on the adoption of advanced Databricks features. * Lakeflow Declarative Pipelines (LDP / formerly DLT) for production-grade ETL with built-in data quality and lineage. * Lakeflow Connect for managed ingestion from SaaS, databases, and file sources. * Serverless Compute (SQL warehouses, jobs, notebooks) for cost and operational efficiency. * Unity Catalog for unified governance, lineage, and fine-grained access control. * Databricks Asset Bundles (DAB) for CI/CD and environment promotion * Databricks SQL, AI/BI Dashboards, Genie for self-service analytics * Expertise in Data Bulid Tool (DBT) and Databricks Autoloader * Databricks SQL, AI/BI Dashboards, Genie for self-service analytics * MLflow, Model Serving, and Mosaic AI for ML and GenAI workloads * Conduct architecture deep-dives, PoCs, and workshops - including cost modelling roadmaps, runbooks and executive presentations. * Produce Client ready deliverables. HLD / LLD documents, reference architecture, migration road maps, runbook and execution presentations * Partner with sales, delivery, and Databricks field teams to shape proposals, SoWs, and bid responses. * Stay ahead of the Databricks product roadmap and evangelize new capabilities internally and with customers. * Mentor data engineers, platform engineers, and junior architects on Databricks best practices. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)