Lead Data Engineer

Insight Global
Spring, TX, United States
about 1 month ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Data Analysis Microsoft Azure Code Generation Information Engineering Extract Transform Load (ETL) Dimensional Modeling Metadata Oracle (Applications) Power BI Standard Sql SQL Databases Oracle Fusion Middleware
+5 more
Git Data Lakes Pyspark Data Pipelines Databricks

Job description

We are seeking a hands-on Lead Data Engineer to support a large-scale Oracle Fusion migration and analytics modernization initiative. This individual will serve as the technical lead for the Data Engineering workstream, helping drive architecture decisions, delivery planning, estimations, mentoring, and execution. The team is migrating legacy Oracle financial data models into a Databricks Lakehouse environment, building near real-time data pipelines, modernizing DBT models, and supporting downstream Power BI reporting.

Key Responsibilities

  • Lead architecture and technical design decisions for the Data Engineering team

  • Own delivery planning, estimation, sprint execution, and technical oversight

  • Mentor and provide guidance to Data Engineers

  • Design and optimize Databricks Lakehouse solutions

  • Build and support ingestion and transformation pipelines

  • Lead DBT model development, conversion, and refactoring efforts

  • Establish engineering standards and best practices

  • Optimize Gold Layer Delta tables for Power BI consumption

  • Partner closely with BI, QA, and Project teams to ensure successful delivery

  • Identify technical risks, dependencies, and blockers proactively

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

  • 10+ years of Data Engineering experience

  • 5+ years of Databricks experience

  • Strong experience with:

  • Databricks

  • Unity Catalog

  • PySpark

  • SQL

  • DBT

  • Delta Lake

  • Lakeflow/DLT

  • Azure DevOps

  • Git

  • Advanced dimensional modeling experience

  • Experience leading technical teams and mentoring engineers

  • Expertise optimizing data models for Power BI reporting and analytics

  • Experience modernizing legacy ETL and SQL workloads * Oracle Fusion ERP experience

  • BICC extraction experience

  • Financial reporting or financial data domain experience

  • Metadata-driven frameworks

  • Code generation or AI-assisted development experience

  • Agentic engineering experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all