Databricks Architect (Insurance Domain) - Remote

Saransh Inc
United States
24 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$145,600.0 - $166,400.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Agile Methodology Amazon Web Services Bash Shell Big Data Cloud Computing Cloud Database Data Architecture Data Governance Extract Transform Load (ETL) Data Systems Database Design
+19 more
Apache Hadoop Hadoop Distributed File System Python (Programming Language) Linked Data Microsoft SQL Server NoSQL Oracle Databases Oracle (Applications) Performance Tuning Systems Development Life Cycle Standard Sql Azure Data Lake Data Ingestion Azure Data Factory Apache Spark Pyspark Cassandra Data Management Databricks

Job description

We are seeking a highly skilled and motivated Databricks Architect with specialized expertise in the Insurance domain to join our dynamic team remotely. In this role, you will lead the design, development, and implementation of advanced data solutions leveraging Databricks platform to drive innovative insights and strategic decision-making. Your deep understanding of cloud-based data architectures, big data technologies, and insurance-specific data challenges will empower organizations to optimize their data management and analytics capabilities. This is an exciting opportunity to influence enterprise-wide data strategies while working in a collaborative, fast-paced environment committed to excellence and innovation., * Lead end-to-end system design for large-scale data architecture projects within the insurance sector, ensuring scalable and efficient solutions.

  • Develop and optimize ETL pipelines using Databricks, Spark, Python, Java, and Bash scripts to facilitate seamless data ingestion, transformation, and loading processes.
  • Architect cloud database solutions utilizing Azure Data Lake, Azure Data Warehouse, AWS services, and other cloud infrastructure to support enterprise data needs.
  • Implement robust data modeling practices including master data management, linked data integration, and schema design to enhance data quality and accessibility.
  • Collaborate with cross-functional teams on system development lifecycle activities following Agile methodologies to deliver high-quality solutions on time.
  • Integrate diverse data sources such as NoSQL databases (e.g., Cassandra), Microsoft SQL Server, Oracle, Hadoop ecosystems, and Informatica for comprehensive data management.
  • Conduct performance tuning and scalability assessments on big data platforms to ensure optimal system performance under increasing workloads.
  • Support business intelligence initiatives by designing scalable analytics solutions that deliver actionable insights for insurance operations.
  • Ensure compliance with industry standards for data governance, security, and privacy in cloud-based environments.

Requirements

  • Proven experience as a Data Architect or similar role with a focus on Databricks platform within the insurance industry or related domains.
  • Strong expertise in cloud database architecture including Azure Data Lake, Azure Data Warehouse, AWS cloud services, and related infrastructure components.
  • Extensive hands-on experience with Spark (PySpark/Scala), Python, Java programming languages for large-scale data processing tasks.
  • Deep understanding of NoSQL databases, SQL Server, Oracle databases, Hadoop ecosystem components including Hadoop Distributed File System (HDFS).
  • Skilled in designing ETL pipelines using Informatica or similar tools; proficient in SQL for complex querying and database design.
  • Knowledge of master data management principles and linked data concepts for integrated enterprise data solutions.
  • Familiarity with Agile project management frameworks; ability to work collaboratively in fast-paced environments.
  • Strong analytical skills with experience in data modeling projects, performance tuning, scalability planning, and big data analytics.
  • Excellent communication skills to articulate technical concepts clearly across diverse teams and stakeholders.

Benefits & conditions

$70 - $80 an hour - Contract

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all