Databricks Architect with P&C

DEREX Technologies, Inc.
Michigan City, IN, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Business Analytics Applications Cloud Computing Computer Programming Databases Data Architecture Information Engineering Data Infrastructure Data Integration Extract Transform Load (ETL) Data Warehousing
+24 more
Distributed Data Store IT Management Oracle Data Service Integrator Oracle SQL Developer Performance Tuning Query Optimization Power BI Cloud Services SQL Stored Procedures SQL Databases Data Streaming Tableau (Software) Data Strategy Pyspark Information Technology Data Analytics WebFOCUS Apache Kafka Data Management Tools for Reporting Stream Processing Data Pipelines Confluent Databricks

Job description

We are seeking an experienced Data & Analytics Architect to lead the design and delivery of modern cloud-native data platforms and analytics solutions for clients in the Commercial Property & Casualty (P&C) Insurance domain. This role requires deep expertise in AWS-based data architectures, modern data platforms, enterprise data strategy, and insurance business processes.

The ideal candidate will act as a trusted advisor to business and technology stakeholders, helping organizations leverage data as a strategic asset through scalable data platforms, advanced analytics, and business intelligence solutions., * Partner with customers to position data as a strategic business asset, enabling them to differentiate through modern data platforms, BI, and advanced analytics solutions.

  • Engage with business stakeholders, IT leadership, and enterprise architects to design and implement scalable, cloud-native data architectures, with a strong focus on AWS-based solutions.
  • Define and drive enterprise data strategies and technology roadmaps, including architecture design, data modeling, and stepwise execution of modern data platforms supporting diverse analytics use cases.
  • Lead Data & Analytics maturity assessments and strategy workshops, ensuring alignment with business goals around performance, scalability, flexibility, and cost optimization.
  • Provide thought leadership on modern data and analytics technologies, enabling innovation in BI, advanced analytics, and predictive modeling.
  • Design, prototype, and deliver end-to-end cloud data solutions, enabling new digital capabilities, especially in the Property & Casualty (P&C) Insurance domain.

Requirements

Do you have experience in System tuning?, * 15+ years of IT experience, including 4+ years in architecting and delivering cloud-native data solutions.

  • Minimum 3+ years of hands-on experience in the Commercial P&C Insurance domain (mandatory).
  • Strong expertise in implementing end-to-end Modern Data Platforms on AWS, using advanced processing frameworks such as Databricks
  • Provide production support for Databricks-based data pipelines and workflows
  • Monitor jobs, clusters, and data pipelines to ensure smooth operations
  • Handle P1/P2 incidents, perform troubleshooting, and ensure timely resolution
  • Perform root cause analysis (RCA) and implement preventive measures
  • Support batch and streaming data pipelines built using Databricks (PySpark/SQL)
  • Manage and optimize Databricks clusters for performance and cost

Technical Skills

Data Platforms & Cloud

  • Deep understanding of cloud-native data architectures, data engineering pipelines, and data management frameworks.
  • Hands-on experience with AWS services (e.g., S3).
  • Expertise in data warehouse design, dimensional modelling, and columnar database architectures.

Database & Programming (Mandatory)

  • Strong hands-on expertise in Oracle PL/SQL (must-have) including performance tuning, complex query optimization, and stored procedure development.
  • Experience working with relational and distributed databases across enterprise environments.

ETL / ELT & Data Integration

  • Strong knowledge of ETL/ELT concepts and tools, including:
  • Oracle Data Integrator (ODI) - preferred
  • Experience with modern ETL frameworks and pipelines
  • Exposure to streaming and real-time data processing, including technologies like Kafka (Confluent).

BI & Reporting

  • Hands-on experience with BI and reporting tools, with preference for:
  • WebFOCUS (added advantage)
  • Other BI tools such as Tableau / Power BI
  • Ability to translate business requirements into actionable dashboards and analytics solutions.

About the company

Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.

With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · WWC Europe 2026

Videos

See all

Related articles

See all