Databricks Data Engineer / Master Data Management (MDM) Speciali

Kentro LLC
Woodlawn, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 165K

Job location

Woodlawn, United States of America

Tech stack

Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
JIRA
Business Systems
Cloud Computing
Code Review
Information Systems
Data Architecture
Information Engineering
Data Governance
ETL
Data Systems
Identity and Access Management
Python
Machine Learning
Meta-Data Management
Performance Tuning
Power BI
SQL Databases
Data Streaming
Tableau
Enterprise Data Management
Data Ingestion
Snowflake
Spark
Cloudformation
Data Lake
PySpark
Information Technology
Data Lineage
Data Management
Functional Programming
Cloudwatch
Data Pipelines
Databricks

Job description

The successful candidate will have hands-on experience developing and maintaining Databricks data solutions while supporting enterprise data management, governance, and Master Data Management (MDM) initiatives. This individual will work closely with technical teams and business stakeholders to build scalable data pipelines, improve data quality, and support reporting and analytics across multiple business systems., This is an excellent opportunity for a mid-level data engineer who enjoys working with modern cloud technologies, Databricks, and enterprise data platforms in a collaborative federal consulting environment., Databricks Engineering

  • Develop, maintain, and optimize Databricks notebooks, workflows, and ETL/ELT pipelines.
  • Build and maintain data ingestion pipelines using PySpark, SQL, and Delta Lake.
  • Support Medallion Architecture (Bronze, Silver, Gold) and Lakehouse implementations.
  • Assist with performance tuning, cluster optimization, and operational support.
  • Support Unity Catalog, data governance, and security best practices.

Master Data Management

  • Support enterprise Master Data Management initiatives.
  • Assist with data quality, matching, standardization, and data stewardship activities.
  • Work with enterprise data governance teams to improve metadata, lineage, and business glossary initiatives.
  • Help ensure consistency and integrity of enterprise data across multiple systems.

Data & Business Intelligence

  • Partner with business users to understand reporting requirements.
  • Support MI/BI reporting initiatives.
  • Develop datasets supporting dashboards and analytics.
  • Troubleshoot data quality and reporting issues.

Project Collaboration

  • Participate in Agile ceremonies.
  • Work with cross-functional technical teams.
  • Document technical solutions and data flows.
  • Participate in code reviews and knowledge sharing., * Willing and able to obtain and maintain Public Trust Clearance
  • Must meet updated ID requirements: https://www.gsa.gov/technology/it-contract-vehicles-and-purchasing-programs/federal-credentialing-services/get-appointment-help/bring-required-documents
  • If you do not currently meet the ID requirements outlined, you must be willing and able to update your current forms of ID in a timely manner to complete the suitability process successfully.

This role is flexible in that it can be a FT/W2 or a 1099 with a potential to transition to a FT/W2 employee position in the future.

Requirements

  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
  • Minimum of 5 years of experience designing, developing, and supporting enterprise data solutions using Databricks.
  • Minimum of 5 years of experience with SQL and Python/PySpark.
  • Experience developing ETL/ELT pipelines and working with Delta Lake and Lakehouse architecture.
  • Experience working within AWS cloud environments.
  • Experience supporting enterprise data governance and data quality initiatives.
  • Experience working in Agile development environments.

Required Certification

Must possess an active Databricks certification, such as:

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional
  • Databricks Certified Data Analyst Associate
  • Databricks Certified Machine Learning Associate
  • Other current Databricks certifications, Experience with one or more of the following:
  • AWS Databricks
  • AWS services (S3, IAM, Lambda, Glue, EMR, Redshift, Athena, CloudFormation, CloudWatch)
  • Apache Spark
  • Delta Lake
  • Unity Catalog
  • Master Data Management (MDM)
  • Informatica MDM
  • Reltio
  • Profisee
  • Snowflake
  • Data Governance
  • Data Catalog
  • Metadata Management
  • Data Lineage
  • Power BI or Tableau
  • Jira / Agile methodologies

Federal consulting experience is highly preferred.

Experience supporting Public Trust programs is preferred.

Benefits & conditions

Salary Range: The salary for this position is between $145,000 - $165,000 annually. Factors affecting pay within this range may include geography/market, skills, education, experience, and other qualifications of the successful candidate.

Apply for this position