> Markdown version of [/jobs/ext/4521429-databricks-lead-architecture](https://www.wearedevelopers.com/jobs/ext/4521429-databricks-lead-architecture). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Lead/Architecture - **Company:** Tech Tammina LLC - **Location:** San Francisco, CA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Cloud Computing, Continuous Integration, Information Engineering, Data Masking, DevOps, Metadata, Meta-Data Management, Performance Tuning, Role-Based Access Control, SQL Databases, Data Streaming, Azure Service Bus, Data Ingestion, Data Lakes, Pyspark, Data Lineage, Apache Kafka, Data Management, Cloud Optimization, Stream Processing, Data Pipelines, Serverless Computing, Databricks - **Published:** November 2, 2026 - **Apply:** https://www.careerbuilder.com/job-details/databricks-lead-architecture-san-francisco-ca--ddd0464e-1264-4238-8d4d-f90f51c92103 ## About the Role Cloud Computing, Data Management, Performance Tuning/Optimization, Metadata, Enterprise Architecture, Amazon Web Services (AWS), Mentoring, Use Cases, Business Intelligence, Data Science ## Description Architecture & Design: * Define and design end-to-end data Lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native services. * Create reference architectures for batch, real-time, and streaming data pipelines. * Architect data ingestion, curation, storage, and governance frameworks. * Ensure the platform is scalable, secure, and optimized for performance and cost. * Establish standards for data lineage, metadata management, and compliance. * Work with enterprise architects to align Databricks solutions with the overall cloud strategy (AWS). Leadership & Delivery: * Lead and mentor a team of data engineers in building robust data pipelines. * Collaborate with data scientists, BI teams, and business stakeholders to enable advanced analytics and AI/ML use cases. * Drive adoption of DevOps and CI/CD practices for data engineering. * Review designs and solutions to ensure adherence to architectural principles. Implementation & Optimization: * Build, optimize, and manage large-scale PySpark/SQL pipelines in Databricks. * Enable real-time data processing through Kafka, Kinesis, or Event Hubs. * Implement security best practices, including RBAC, data masking, and encryption.