Databricks Data Engineer / Master Data Management (MDM) Speciali

Kentro LLC
Woodlawn, MD, United States
26 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
5 years minimum
Compensation
$145,000.0 - $165,000.0
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Amazon S3 JIRA Business Systems Cloud Computing Code Review Information Systems Data Architecture Information Engineering Data Governance Extract Transform Load (ETL)
+24 more
Data Systems Identity and Access Management Python (Programming Language) Machine Learning Meta-Data Management Performance Tuning Power BI SQL Databases Data Streaming Tableau (Software) Enterprise Data Management Data Ingestion Snowflake Apache Spark Cloudformation Data Lakes Pyspark Information Technology Data Lineage Data Management Functional Programming Cloudwatch Data Pipelines Databricks

Job description

The successful candidate will have hands-on experience developing and maintaining Databricks data solutions while supporting enterprise data management, governance, and Master Data Management (MDM) initiatives. This individual will work closely with technical teams and business stakeholders to build scalable data pipelines, improve data quality, and support reporting and analytics across multiple business systems., This is an excellent opportunity for a mid-level data engineer who enjoys working with modern cloud technologies, Databricks, and enterprise data platforms in a collaborative federal consulting environment., Databricks Engineering

  • Develop, maintain, and optimize Databricks notebooks, workflows, and ETL/ELT pipelines.
  • Build and maintain data ingestion pipelines using PySpark, SQL, and Delta Lake.
  • Support Medallion Architecture (Bronze, Silver, Gold) and Lakehouse implementations.
  • Assist with performance tuning, cluster optimization, and operational support.
  • Support Unity Catalog, data governance, and security best practices.

Master Data Management

  • Support enterprise Master Data Management initiatives.
  • Assist with data quality, matching, standardization, and data stewardship activities.
  • Work with enterprise data governance teams to improve metadata, lineage, and business glossary initiatives.
  • Help ensure consistency and integrity of enterprise data across multiple systems.

Data & Business Intelligence

  • Partner with business users to understand reporting requirements.
  • Support MI/BI reporting initiatives.
  • Develop datasets supporting dashboards and analytics.
  • Troubleshoot data quality and reporting issues.

Project Collaboration

  • Participate in Agile ceremonies.
  • Work with cross-functional technical teams.
  • Document technical solutions and data flows.
  • Participate in code reviews and knowledge sharing., * Willing and able to obtain and maintain Public Trust Clearance
  • Must meet updated ID requirements: https://www.gsa.gov/technology/it-contract-vehicles-and-purchasing-programs/federal-credentialing-services/get-appointment-help/bring-required-documents
  • If you do not currently meet the ID requirements outlined, you must be willing and able to update your current forms of ID in a timely manner to complete the suitability process successfully.

This role is flexible in that it can be a FT/W2 or a 1099 with a potential to transition to a FT/W2 employee position in the future.

Requirements

  • Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
  • Minimum of 5 years of experience designing, developing, and supporting enterprise data solutions using Databricks.
  • Minimum of 5 years of experience with SQL and Python/PySpark.
  • Experience developing ETL/ELT pipelines and working with Delta Lake and Lakehouse architecture.
  • Experience working within AWS cloud environments.
  • Experience supporting enterprise data governance and data quality initiatives.
  • Experience working in Agile development environments.

Required Certification

Must possess an active Databricks certification, such as:

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional
  • Databricks Certified Data Analyst Associate
  • Databricks Certified Machine Learning Associate
  • Other current Databricks certifications, Experience with one or more of the following:
  • AWS Databricks
  • AWS services (S3, IAM, Lambda, Glue, EMR, Redshift, Athena, CloudFormation, CloudWatch)
  • Apache Spark
  • Delta Lake
  • Unity Catalog
  • Master Data Management (MDM)
  • Informatica MDM
  • Reltio
  • Profisee
  • Snowflake
  • Data Governance
  • Data Catalog
  • Metadata Management
  • Data Lineage
  • Power BI or Tableau
  • Jira / Agile methodologies

Federal consulting experience is highly preferred.

Experience supporting Public Trust programs is preferred.

Benefits & conditions

Salary Range: The salary for this position is between $145,000 - $165,000 annually. Factors affecting pay within this range may include geography/market, skills, education, experience, and other qualifications of the successful candidate.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · WWC Europe 2026

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all