> Markdown version of [/jobs/ext/1389761-databricks-developer-java-apache-spark-with-irs-mbi-clearance-required](https://www.wearedevelopers.com/jobs/ext/1389761-databricks-developer-java-apache-spark-with-irs-mbi-clearance-required). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Databricks Developer (Java & Apache Spark) with IRS MBI Clearance required

- **Company:** M & M CONCEPTS & DESIGN LLC
- **Location:** Washington, DC, United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Agile Methodology, Amazon S3, Apache HTTP Server, Unit Testing, Batch Processing, Big Data, Cloud Database, Software Quality, Continuous Integration, Data Validation, Data Cleansing, Information Engineering, Extract Transform Load (ETL), Data Structures, Data Systems, Software Debugging, DevOps, Distributed Systems, Github, Hadoop Distributed File System, Monitoring of Systems, Apache HBase, Apache Hive, Junit, Python (Programming Language), Object-Oriented Software Development, Performance Tuning, Mockito, Cloudera, Data Streaming, Testng, Parquet, Data Processing, Apache Yarn, Apache Spark, AWS Lambda, Backend, Data Lakes, Semi-structured Data, Kubernetes, Information Technology, Avro, Apache Kafka, Data Management, Api Design, Data Pipelines, Jenkins, Databricks
- **Published:** July 22, 2026
- **Apply:** https://www.careerjet.com/job/us3b070c13ad9fa70ba116bf4922778388/eaa

## About the Role

Active federal background clearance (client-issued laptop is a plus)
Bachelor's degree in Computer Science or a related field
8+ years of hands-on experience in data engineering or big data development
Technical Skills
Data & Systems
Experience working with large enterprise or government data systems
Good understanding of data structures, security, and compliance
Java
Strong experience with Java 8 or newer
Comfortable with Streams, Lambdas, and object-oriented design
Apache Spark
Hands-on experience with Spark Core, Spark SQL, and DataFrames
Understanding of RDDs and when to use them
Experience with batch processing and streaming
Strong skills in Spark performance tuning
Able to debug jobs using Spark UI and logs
Big Data Tools
Experience with tools like HDFS, Hive, or HBase
Familiar with Kafka, S3, or cloud-based data lakes
Experience with Parquet, Avro, or ORC formats
ETL & Data Processing
Experience building batch and real-time ETL pipelines
Skilled in data cleansing, transformation, and enrichment
DevOps & Deployment
Experience running Spark on YARN, Kubernetes, or cloud platforms
Familiar with CI/CD tools like Jenkins or GitHub Actions
Experience with monitoring tools and production logs
Testing & Code Quality
Unit testing using JUnit or TestNG
Experience with Mockito or similar tools
Comfortable validating data and testing Spark jobs
Ways You'll Succeed
You're used to working in Agile teams
You document your work clearly
You stay calm and focused when troubleshooting production issues
Nice to Have:
Experience with Scala or Python in Spark
Hands-on experience with Databricks or Google Dataproc
Knowledge of Delta Lake or Apache Iceberg
Background in data modeling and performance design

3M Consultancy
*

## Description

We are looking for a Databricks Developer who can design, build, and support large-scale data processing solutions. This role focuses on working with complex, high-volume data in a secure environment. You should be comfortable writing clean Java code, building Spark jobs, and improving performance in distributed systems.
You'll work closely with engineers, analysts, and business teams to deliver reliable data pipelines that scale well and meet security and compliance requirements.
What You'll Do
Build and maintain data pipelines using Apache Spark on Databricks
Write clean and efficient Java (Java 8 or higher) following best coding practices
Work with large structured and semi-structured data sets
Tune Spark jobs to improve performance, stability, and cost
Partner with other teams to understand requirements and deliver solutions
Make sure data handling follows security and governance standards
Investigate and fix issues in production environments, Sr. Backend Developer (Java & Kafka) Location: Washington, DC, Hybrid role Responsibilities: Backend & API Development: Design, develop, and maintain performant, enterprise-gra…

 + 6 hours ago
 + Apply easily


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How Unit Testing Saved My Career](https://www.wearedevelopers.com/videos/1642-how-unit-testing-saved-my-career)
- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [From boy scouting to redrawing the landscape](https://www.wearedevelopers.com/videos/1140-from-boy-scouting-to-redrawing-the-landscape)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)