Databricks Architect

We are seeking an experienced Databricks Architect with a strong background in healthcare to design, develop, and implement scalable, secure, and high-performance data solutions. The ideal candidate will have extensive expertise in Databricks architecture, cloud data platforms, data engineering, and modern lakehouse solutions, along with hands-on experience working with healthcare data and systems.

Healthcare industry experience is mandatory for this position. The candidate should be capable of translating complex business and data requirements into robust architectural solutions while ensuring data quality, security, governance, and regulatory compliance., * Design and implement scalable data architectures using the Databricks Lakehouse Platform.

• Lead the architecture and development of enterprise-level data engineering solutions and data pipelines.
• Develop and optimize data processing workflows using Apache Spark, PySpark, Python, and SQL.
• Design and implement ETL/ELT pipelines for batch and real-time data processing.
• Leverage Delta Lake, data modeling, and lakehouse architecture principles to build reliable data platforms.
• Integrate data from multiple healthcare systems, including EHR/EMR platforms and other healthcare data sources.
• Ensure healthcare data solutions comply with applicable security, privacy, governance, and regulatory requirements, including HIPAA where applicable.
• Establish data governance, data quality, metadata management, and access control standards.
• Optimize Databricks workloads for performance, scalability, reliability, and cost efficiency.
• Collaborate with business stakeholders, data engineers, analysts, and other technical teams to define architecture and implementation strategies.
• Provide technical leadership, architectural guidance, and best practices for data engineering teams.
• Evaluate emerging technologies and recommend improvements to the organization’s data platform.

• Strong experience in Databricks architecture and solution design.
• Mandatory healthcare industry experience.
• Hands-on expertise with the Databricks Lakehouse Platform.
• Strong knowledge of Apache Spark, PySpark, Python, and SQL.
• Experience designing and implementing complex ETL/ELT data pipelines.
• Expertise in Delta Lake, data modeling, and data warehousing concepts.
• Experience with cloud platforms such as Microsoft Azure or AWS.
• Strong understanding of data integration, data governance, data quality, and security.
• Experience working with healthcare data, healthcare applications, or healthcare data integration.
• Knowledge of healthcare data standards such as HL7 and FHIR is preferred.
• Understanding of HIPAA and healthcare data privacy requirements.
• Strong problem-solving, communication, and technical leadership skills., * Experience integrating data from EHR/EMR systems, claims platforms, clinical systems, or other healthcare applications.
• Experience with real-time data processing and streaming technologies.
• Familiarity with CI/CD, Infrastructure as Code, and automated data pipeline deployment.
• Experience with Databricks performance tuning, monitoring, and cost optimization.
• Experience establishing enterprise data architecture standards and best practices.

Candidate Profile

The ideal candidate is a hands-on Databricks Architect who combines strong technical architecture expertise with practical healthcare data experience. The candidate should be able to lead data platform design, guide engineering teams, and deliver secure, scalable, and compliant healthcare data solutions.

Important: Healthcare industry experience is mandatory. This is a remote, long-term contract opportunity.