Databricks Engineer

Blu Omega
Ashburn, VA, United States
13 days ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$80,000.0 - $110,000.0
Working hours
Regular working hours

Tech stack

Unity 3d Amazon Web Services Data Analysis Microsoft Azure Data as a Services Information Engineering Data Governance Data Systems Apache Hive Python (Programming Language) Machine Learning Systems Development Life Cycle
+14 more
Data Streaming Systems Integration Datadog Cloud Platform System Data Lakes Pyspark Information Technology Deployment Automation Data Analytics Machine Learning Operations Stream Processing Software Version Control Data Pipelines Databricks

Job description

Blu Omega is seeking a Databricks Engineer to support a federal program focused on data analytics and mission-critical government operations. This role operates within a remote environment and is responsible for designing, building, and operating scalable data solutions. The position requires experience supporting data engineering, analytics, and cloud-based data platforms., * Design, develop, and maintain scalable Databricks data pipelines using PySpark, Spark SQL, Delta Lake, and Unity Catalog to deliver high-quality, mission-critical data assets

  • Build and maintain automated ingestion, transformation, and processing workflows supporting analytics, reporting, and operational decision-making
  • Operate and optimize Databricks clusters, jobs, and workflows ensuring reliability, performance, and cost efficiency
  • Integrate Databricks with enterprise CI/CD pipelines and SDLC tooling for automated deployments, source control, and testing
  • Implement data quality, validation, and observability frameworks to enhance data accuracy and trustworthiness
  • Monitor and troubleshoot data pipelines, platform performance, and production workloads to identify and resolve issues proactively
  • Collaborate with stakeholders and cross-functional teams to translate operational requirements into technical solutions
  • Develop and maintain technical documentation related to data pipelines, architecture, and operational processes

Requirements

  • 3+ years of experience in data engineering, analytics, or related technical roles
  • 2+ years of hands-on experience with the Databricks platform
  • Strong experience developing data solutions using PySpark and Spark SQL
  • Experience working with Databricks clusters, jobs, workflows, Delta Lake, and Unity Catalog in production environments
  • Experience designing and maintaining automated data pipelines and transformation workflows
  • Experience integrating Databricks with CI/CD pipelines and enterprise SDLC tooling
  • Working knowledge of Python for data engineering, automation, and ML workflows
  • Knowledge of cloud platforms such as AWS, Microsoft Azure, or GCP and associated data services
  • Understanding of data quality, validation, monitoring, and production support practices
  • Strong analytical and troubleshooting skills
  • Effective collaboration skills with technical and non-technical teams
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination
  • Bachelor’s degree in computer science, data science, engineering, or related field, * Experience supporting federal government or regulated industries
  • Experience developing or operationalizing machine learning solutions within Databricks
  • Experience with MLflow for machine learning lifecycle management
  • Knowledge of streaming frameworks, real-time data processing, and observability tooling
  • Experience implementing data governance, lineage, and access control practices
  • Databricks certification or cloud platform certification from AWS, Azure, or GCP

Benefits & conditions

Salary Range: $80,000.00 - $110,000.00 Final compensation is based on technical skills, experience, education, certifications, and clearance.

Blu Omega Benefits & Perks

  • Medical, Dental, and Vision coverage through national providers
  • 401(k) with company match (eligible after 6 months; vesting applies)
  • Company-paid Life and AD&D insurance with additional voluntary options
  • Short-term and long-term disability options
  • Employee Assistance Program (EAP) with 24/7 confidential support and mental health resources
  • Telehealth and virtual care options
  • Pet insurance, legal services, and identity theft protection options
  • Paid Time Off (PTO) for eligible employees
  • Paid federal holidays for salaried employees
  • Access to wellness programs, discounts, and lifestyle benefits
  • Benefits availability may vary based on role and employment status

About the company

Blu Omega is a Woman-Owned Small Business (WOSB) providing technology and cybersecurity solutions to federal agencies and enterprise clients nationwide. Headquartered in Ashburn, VA, we support mission-critical programs across civilian and defense sectors, including health, national security, and regulatory environments. We partner with government agencies and large integrators to deliver expertise in data modernization, cybersecurity operations, cloud and infrastructure modernization, and enterprise IT support, supporting task orders and programs that require cleared personnel and compliant delivery.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:36 min

Visualizing memory limits and isolating suspicious endpoints

Dina Matveev Dina Matveev · Europe 2026 Virtual

2:36 min

Development tools for spatial computing and drones

Zaid Zaim Zaid Zaim · World Congress 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:30 min

Technical trade-offs between game engines and headsets

Zaid Zaim Zaid Zaim · World Congress 2023

1:08 min

Analyzing error logs and root causes using artificial intelligence

Nishil Patel Nishil Patel · World Congress 2025

Videos

See all

Related articles

See all