Data Engineer - Oracle PL/SQL, Databricks, Java & Spark

Intuitive Insights LLC
Houston, TX, United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Java (Programming Language) Amazon Web Services Amazon S3 Business Logic Data Warehousing Jinja (Template Engine) Python (Programming Language) Oracle SQL Developer Performance Tuning Standard Sql Scala (Programming Language)
+12 more
SQL Databases Macros Snowflake Apache Spark Spring-boot Data Lakes Kubernetes Apache Kafka Cloud Migration Data Pipelines Docker Databricks

Job description

We are looking for an experienced Senior Data Engineer to support modernization of the Credit Risk technology stack., * Modernize and upgrade enterprise Credit Risk technology platforms.

  • Develop and maintain complex Oracle PL/SQL packages, procedures, views, and business logic.
  • Develop and optimize SQL and Databricks SQL queries.
  • Work with Databricks, Delta Lake, Unity Catalog, and dbt.
  • Develop data pipelines using Java, Python, Scala, and Apache Spark.
  • Implement dimensional data modeling, SCD2, and historical data tracking.
  • Perform Spark and Databricks performance tuning.
  • Support legacy-to-cloud data migration, reconciliation, and validation.

Requirements

  • Strong Oracle PL/SQL and SQL expertise.
  • Databricks, Databricks SQL, Delta Lake, and Unity Catalog.
  • Hands-on dbt experience, including models, snapshots, macros, Jinja, and testing.
  • Java, Python, Scala, and Spark experience.
  • Strong data modeling and performance optimization experience.
  • Legacy-to-cloud migration and data reconciliation experience.

Preferred Skills:

  • AWS, S3, Snowflake, Dremio.
  • Spring Boot, Kafka, Kubernetes, and Docker.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…