Database Engineer

Creative Circle
Santa Ana, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Santa Ana, United States of America

Tech stack

Airflow
Software as a Service
Databases
Directed Acyclic Graph (Directed Graphs)
Software Debugging
Python
Microsoft SQL Server
Operational Databases
Standard Sql
SQL Databases
Data Streaming
Systems Integration
Data Ingestion
Connectivity Problems
Spark
Data Lake
PySpark
REST
Databricks

Job description

Our mortgage industry client is seeking a Database Engineer to own the operation, reliability, and evolution of its Databricks Lakehouse platform post-migration. This hands-on role focuses on maintaining performant, cost-efficient, and compliant ingestion pipelines, transformation layers, and warehouse solutions in a regulated lending environment., * Own day-to-day operation of Databricks jobs, pipelines, clusters, Delta Lake tables, and SQL warehouses

  • Develop and optimize Spark transformations across bronze/silver/gold layers, including incremental ingestion (Auto Loader, Structured Streaming)
  • Maintain orchestration using Databricks Workflows and Apache Airflow to meet SLA requirements
  • Administer governance and access via Unity Catalog, ensuring proper PII controls
  • Manage and tune MSSQL databases, focusing on performance, indexing, and schema design
  • Monitor and optimize DBU usage and cluster costs through alerting and right-sizing
  • Troubleshoot pipeline failures, data quality issues, schema drift, and connectivity problems
  • Support platform reliability, documentation, and shared operational ownership across the team

In this position, you may have access to client or customer systems, confidential and/or proprietary information or data, including financial information. This position is onsite and requires you to work closely with other individuals in a collaborative team environment.

Requirements

  • 3+ years of production data engineering experience
  • Databricks Certification
  • Strong Databricks expertise, including notebooks, jobs, workflows, cluster configuration, SQL warehouses, and Unity Catalog
  • Proficiency in Python, PySpark, and SQL
  • Solid MSSQL / SQL Server experience
  • Hands-on experience with Apache Airflow (DAGs, scheduling, debugging)
  • Experience integrating SaaS/CRM data sources (e.g., Salesforce APIs)
  • Ability to operate and troubleshoot live production pipelines
  • Strong communication and technical documentation skills

Benefits & conditions

Benefits include Medical, Dental, and Vision insurance, company-paid life insurance, 401K with a generous employer match and additional benefits such as Free Legal Services and an Employee Loan Program.

Apply for this position