Senior Technical Architect

HCL America Inc.
Chicago, IL, United States
5 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$127,000.0 - $180,000.0
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Artificial Intelligence Amazon Web Services Microsoft Azure Batch Processing Cloud Computing Continuous Integration Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation
+18 more
IBM DB2 Apache Hive Meta-Data Management DataOps Software Deployment Workflow Management Systems Enterprise Data Management Data Ingestion Azure Data Factory Snowflake Apache Spark Data Layers Data Lakes Pyspark Data Lineage Guidewire Legacy Systems Databricks

Job description

Databricks Architect responsible for designing and implementing a scalable, cloud-native Lakehouse platform supporting RCIS Data Modernization. Lead the architecture of Bronze, Silver, and future Gold data layers, integrating Guidewire CDA, CIMax/DB2, legacy systems, and external regulatory data sources. Define metadata-driven ingestion, CDC frameworks, data quality, reconciliation, observability, governance, lineage, and security using Databricks, Delta Lake, Unity Catalog, AWS/Azure cloud services, and orchestration tools. Collaborate with enterprise architects, business stakeholders, data engineers, and governance teams to establish a trusted Single Source of Truth (SSOT), enabling audit-ready reporting, regulatory compliance, self-service analytics, and future AI-driven capabilities., Own end-to-end Databricks Lakehouse architecture and provide technical leadership across data ingestion, transformation, governance, reporting, and migration workstreams. Design canonical Policy, Claims, and Billing data models within the Silver Layer, ensuring harmonization between Guidewire and legacy systems. Establish metadata-driven ETL/ELT frameworks, data quality controls, reconciliation processes, lineage, observability, and security standards. Optimize Databricks clusters, Delta Lake performance, cost efficiency, and operational reliability. Govern Unity Catalog implementation, access controls, and compliance requirements. Support architecture reviews, SIT/UAT, cutover planning, production deployment, and hypercare activities. Mentor engineering teams and drive adoption of modern DataOps, automation, and AI-enabled accelerators.

Requirements

Top 6 Key Skillsets - Databricks Architect (RCIS Data Modernization) Databricks Lakehouse Architecture Databricks, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Spark Architecture Enterprise Data Modeling & Modernization Canonical Data Models, SSOT Design, Data Modernization, Bronze/Silver/Gold Layer Architecture Data Engineering & Integration ETL/ELT Frameworks, CDC, Data Ingestion, PySpark, Spark SQL, Real-Time & Batch Processing Data Governance & Quality Data Lineage, Metadata Management, Data Quality, Reconciliation, Observability, Audit Compliance Cloud & Platform Engineering Azure Databricks, Azure Data Factory, Snowflake, Azure DevOps, CI/CD, Infrastructure as Code Crop Insurance & Guidewire Domain Expertise Guidewire CDA, CIMax, Policy, Claims, Billing, APH Yield, Acreage, Premium, Subsidy, Indemnity, RMA Reporting

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…