Databricks Specialist 102454

The Information Technology
United States
1 day ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Amazon S3 Microsoft Azure Cloud Storage Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation Data Security Data Systems
+16 more
Python (Programming Language) Performance Tuning Cloud Services Azure Data Lake SQL Databases Workflow Management Systems Google Cloud Apache Spark Data Lakes Pyspark AWS Glue Machine Learning Operations Cloud Integration Data Pipelines Devsecops Databricks

Job description

  • Design, develop, and optimize data pipelines and ETL/ELT processes using Databricks (SQL, Python, PySpark).
  • Architect and implement scalable, secure data engineering solutions aligned with federal compliance and governance standards.
  • Build and manage Delta Lake architectures, including schema evolution, data quality, and performance tuning.
  • Collaborate with federal stakeholders to translate business requirements into technical solutions within the Databricks platform.
  • Implement CI/CD workflows for data pipelines and support DevSecOps best practices.
  • Conduct performance analysis, troubleshoot complex data issues, and optimize cluster usage and costs.
  • Develop documentation, data models, and solution designs that support long‑term maintainability.
  • Provide guidance, best practices, and Databricks platform expertise to technical and non‑technical federal clients.
  • Support cloud integration with platforms such as Azure, AWS, or GCP depending on agency environment.

Requirements

We are seeking a highly skilled Federal Consultant with deep expertise in Databricks to support data engineering, analytics modernization, and cloud‑based data platform initiatives across federal programs. The ideal candidate has at least four years of hands‑on Databricks experience and holds (or is able to obtain) the Databricks Data Engineer Professional certification. This role requires strong technical acumen, the ability to advise federal clients, and a passion for building scalable, secure, and compliant data solutions., * Minimum 4 years of hands‑on experience building solutions in Databricks (SQL, Spark, MLflow, Delta Lake).

  • Strong proficiency in Python and/or PySpark for advanced data engineering tasks.
  • Experience with cloud data platforms (Azure Data Lake, AWS S3, GCP Cloud Storage, etc.).
  • Experience working within federal environments or supporting regulated industries.
  • Familiarity with data governance, security, access control, and compliance frameworks (FISMA, FedRAMP, etc.).
  • Databricks Data Engineer Professional Certification or ability to obtain within an agreed timeframe.

Desired Skills:

  • Experience with federal data modernization or cloud migration programs.
  • Knowledge of SQL Warehousing, Unity Catalog, and Databricks governance features.
  • Experience with workflow orchestration tools (Airflow, ADF, AWS Glue, etc.).
  • Experience implementing MLOps and ML pipelines within Databricks.
  • Strong communication skills and the ability to present technical concepts to federal stakeholders.
  • Consultative mindset with the ability to build trust and clarity with federal clients.
  • Strong problem‑solving and analytical abilities.
  • Ability to work collaboratively in multi‑disciplinary federal project teams.

About the company

ManpowerGroup Public Sector (MGPS) provides Skilled Experts and Leading-Edge Solutions to Support Our Nation’s Most Critical Intelligence, Defense and Civilian Missions. MGPS specializes in solving our clients’ diverse linguistic, technical and data management challenges created by the dramatic rise in the volume, variety and complexity of open source data. We harness machine learning, artificial intelligence and the latest data acquisition and mining tools, paired with expert human skills to provide customized solutions for every customer.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…