Databricks Specialist 102454
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
- Design, develop, and optimize data pipelines and ETL/ELT processes using Databricks (SQL, Python, PySpark).
- Architect and implement scalable, secure data engineering solutions aligned with federal compliance and governance standards.
- Build and manage Delta Lake architectures, including schema evolution, data quality, and performance tuning.
- Collaborate with federal stakeholders to translate business requirements into technical solutions within the Databricks platform.
- Implement CI/CD workflows for data pipelines and support DevSecOps best practices.
- Conduct performance analysis, troubleshoot complex data issues, and optimize cluster usage and costs.
- Develop documentation, data models, and solution designs that support long‑term maintainability.
- Provide guidance, best practices, and Databricks platform expertise to technical and non‑technical federal clients.
- Support cloud integration with platforms such as Azure, AWS, or GCP depending on agency environment.
Requirements
We are seeking a highly skilled Federal Consultant with deep expertise in Databricks to support data engineering, analytics modernization, and cloud‑based data platform initiatives across federal programs. The ideal candidate has at least four years of hands‑on Databricks experience and holds (or is able to obtain) the Databricks Data Engineer Professional certification. This role requires strong technical acumen, the ability to advise federal clients, and a passion for building scalable, secure, and compliant data solutions., * Minimum 4 years of hands‑on experience building solutions in Databricks (SQL, Spark, MLflow, Delta Lake).
- Strong proficiency in Python and/or PySpark for advanced data engineering tasks.
- Experience with cloud data platforms (Azure Data Lake, AWS S3, GCP Cloud Storage, etc.).
- Experience working within federal environments or supporting regulated industries.
- Familiarity with data governance, security, access control, and compliance frameworks (FISMA, FedRAMP, etc.).
- Databricks Data Engineer Professional Certification or ability to obtain within an agreed timeframe.
Desired Skills:
- Experience with federal data modernization or cloud migration programs.
- Knowledge of SQL Warehousing, Unity Catalog, and Databricks governance features.
- Experience with workflow orchestration tools (Airflow, ADF, AWS Glue, etc.).
- Experience implementing MLOps and ML pipelines within Databricks.
- Strong communication skills and the ability to present technical concepts to federal stakeholders.
- Consultative mindset with the ability to build trust and clarity with federal clients.
- Strong problem‑solving and analytical abilities.
- Ability to work collaboratively in multi‑disciplinary federal project teams.
About the company
ManpowerGroup Public Sector (MGPS) provides Skilled Experts and Leading-Edge Solutions to Support Our Nation’s Most Critical Intelligence, Defense and Civilian Missions. MGPS specializes in solving our clients’ diverse linguistic, technical and data management challenges created by the dramatic rise in the volume, variety and complexity of open source data. We harness machine learning, artificial intelligence and the latest data acquisition and mining tools, paired with expert human skills to provide customized solutions for every customer.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…