> Markdown version of [/jobs/ext/4669265-lead-data-engineer-with-strong-experience-in-databricks-remote-unites-states-visa-independent-candidates](https://www.wearedevelopers.com/jobs/ext/4669265-lead-data-engineer-with-strong-experience-in-databricks-remote-unites-states-visa-independent-candidates). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer with strong experience in Databricks | Remote (Unites states)---Visa-independent candidates - **Company:** Cyberobotix Technology Inc - **Location:** Austin, United States (Remote available) - **Experience:** Expert - **Contract:** Contract - **Skills:** Unity 3d, Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, BigQuery, Business Systems, Cloud Computing, Cloud Storage, Information Systems, Continuous Integration, Data Cleansing, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Vault Modeling, Data Warehousing, IBM InfoSphere DataStage, Dimensional Modeling, Data Flow Control, Github, Apache Hive, Python (Programming Language), Meta-Data Management, Microsoft SQL Server, Oracle (Applications), Performance Tuning, Power BI, DataOps, Cloudera, Azure Data Lake, SQL Databases, SQL Server Integration Services, Data Streaming, Tableau (Software), Teradata SQL, Enterprise Data Management, Azure Service Bus, Feature Store, Google Cloud, Azure Data Factory, Sql Optimization, Informatica Powercenter, Great Expectations (Foster Youth College-readiness and Support Program), Retrieval-Augmented Generation, Snowflake, Multi-Cloud, Git, Microsoft Fabric, Data Lakes, Pyspark, Git Flow, Information Technology, AWS Glue, Qlikview, AWS Data Analytics, Apache Kafka, Machine Learning Operations, Terraform, Azure Synapse Analytics, Looker Analytics, Data Pipelines, Guidewire, Amazon Redshift, Databricks - **Published:** November 11, 2026 - **Apply:** https://www.dice.com/job-detail/13ac9f44-11e2-4ffb-9c9b-4a7a80409c6c ## About the Role 8-12 years in data engineering, with at least 3-4 years hands-on with Databricks Industry Preference Insurance (P&C, Specialty, Brokerage) or broader BFSI preferred, * 8-12 years of data engineering experience delivering large-scale ETL and data warehouse solutions. * Strong, hands-on Databricks expertise (must-have): PySpark, Spark SQL, Delta Lake, Unity Catalog, Workflows/Jobs, DLT/Lakeflow, Databricks SQL, performance tuning. * Advanced SQL and Python; Scala is a plus. * Proven data warehousing and data modeling experience (Kimball dimensional modeling, SCDs, fact/dimension design). * Hands-on experience with at least one hyperscaler, ideally multi-cloud: * Azure: ADLS Gen2, Azure Data Factory, Synapse, Fabric, Event Hubs * AWS: S3, Glue, Redshift, EMR, Lambda, Kinesis * Google Cloud Platform: BigQuery, Dataflow, Dataproc, Cloud Storage * BI tools: strong Power BI (data modeling, DAX, dataset optimization); exposure to Tableau, Looker or Qlik. * Experience with orchestration (Databricks Workflows, Airflow, ADF) and modern tools such as dbt. * Solid understanding of data governance, security, lineage and metadata management. * Experience with CI/CD, Git-based workflows and Agile delivery. * Excellent communication skills and comfort working directly with client stakeholders. Good to Have * Insurance domain experience (P&C, Specialty/E&S, brokerage, MGAs): policy, claims, billing, underwriting, loss runs, bordereaux, exposure and reinsurance data. Broader BFSI experience is also valued. * Familiarity with insurance platforms and data standards (Guidewire, Duck Creek, Majesco, Applied Epic, ACORD). * Databricks certifications: Data Engineer Associate / Professional. * Cloud certifications (Azure Data Engineer, AWS Data Engineer, Google Cloud Platform Professional Data Engineer). * Snowflake and/or Microsoft Fabric experience. * Exposure to ML/AI data pipelines, feature stores, MLflow, or GenAI/RAG data preparation. * Experience with real-time streaming (Structured Streaming, Kafka)., * Bachelor's or Master's degree in Computer Science, Engineering, Information Systems or a related field, or equivalent practical experience. ## Description We are looking for a strong, hands-on Data Engineer with deep Databricks expertise to design, build and scale enterprise data platforms. You will own end-to-end delivery across ingestion, ETL/ELT, data warehousing, lakehouse architecture and BI enablement, working on at least one major hyperscaler (Azure, AWS or Google Cloud Platform). This role suits someone who can work directly with business and technology leaders, turn requirements into production-grade pipelines, and deliver trusted, analytics-ready data at scale., * Design, build and optimize scalable batch and streaming ETL/ELT pipelines on Databricks (PySpark, Spark SQL, Delta Lake, Delta Live Tables / Lakeflow, Workflows). * Architect and implement Lakehouse solutions using the Medallion (Bronze / Silver / Gold) pattern, with Unity Catalog for governance, lineage and access control. * Build and maintain enterprise data warehouse models (dimensional modeling, star/snowflake schemas, SCDs, Data Vault where relevant) on Databricks SQL, Snowflake, Synapse, Redshift or BigQuery. * Migrate legacy ETL and on-prem warehouses (Informatica, SSIS, DataStage, Teradata, Oracle, SQL Server) to modern cloud lakehouse platforms. * Enable BI and reporting by delivering semantic layers and curated datasets for Power BI (primary), plus Tableau, Looker or Qlik; tune performance for dashboards at scale. * Integrate data from core business systems, APIs, files and third-party sources using ADF, AWS Glue, Fivetran, Kafka/Event Hubs or similar. * Implement data quality, observability and testing frameworks (e.g., DLT expectations, Great Expectations, dbt tests). * Apply CI/CD and DataOps practices (Git, Azure DevOps / GitHub Actions, Databricks Asset Bundles, Terraform). * Optimize cost and performance across clusters, SQL warehouses, storage and queries. * Partner with architects, analysts, data scientists and business stakeholders; mentor junior engineers and contribute to engineering standards.