> Markdown version of [/jobs/ext/4010157-principal-databricks-software-developer](https://www.wearedevelopers.com/jobs/ext/4010157-principal-databricks-software-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Databricks Software Developer

- **Company:** PowerPlan, Inc
- **Location:** Sandy Springs, GA, United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Unity 3d, Artificial Intelligence, Software as a Service, Information Engineering, Machine Learning, Performance Tuning, Service Pack, Software Engineering, Data Streaming, Feature Store, Autoscaling, Apache Spark, Data Lakes, Information Technology, Machine Learning Operations, Cisco, Databricks
- **Published:** October 29, 2026
- **Apply:** https://www.careerbuilder.com/job-details/principal-databricks-software-developer-atlanta-ga--cbe2e2c0-4b54-474a-96ba-a3b25b97250c

## About the Role

Software Development, Cisco Unity, Cost Effectiveness Analysis, Artificial Intelligence (AI), Software as a Service (SaaS), Risk, Leadership, Access Control, Automation, Software Patches, * 8+ years in data engineering, platform engineering, or related software engineering roles, including 3+ years of deep hands-on Databricks experience.

 * Production experience with Spark internals and performance tuning - shuffle behavior, query planning, adaptive query execution, memory pressure, skew, and partitioning.
 * Strong working knowledge of Databricks compute options, cluster policies, instance pools, autoscaling, Photon, and workload right-sizing.
 * A track record of reviewing and improving notebooks, jobs, and pipelines built by other people, quickly spotting what''s driving runtime, cost, or reliability risk.
 * Production experience with Delta Lake, Structured Streaming, Auto Loader, and data quality practices.
 * Strong command of Unity Catalog governance, lineage, permission models, and secure handling of sensitive data.
 * Experience designing resilient job orchestration, including dependency management, retries, timeouts, and alerting.
 * Strong communication skills, including the judgment to translate technical risk into terms stakeholders can act on.
 * Bachelor''s degree in Computer Science, Engineering, or a related field, or equivalent professional experience.

Preferred

 * Databricks certification (Certified Data Engineer or Certified Machine Learning Associate).
 * Experience with MLOps or feature-store platforms.
 * Contributions to open-source data engineering tooling.

## Description

Success will be measured by how quickly you turn platform risk into an evidence-based picture leadership can act on, and by how often teams start bringing you their toughest design decisions before they build.

 * Audit the platform''s highest-priority assets - clusters, jobs, pipelines, notebooks, and access controls - and deliver an evidence-backed picture of the biggest risks within 30 days.
 * Own the design of critical Databricks standards - compute policies, Spark configuration, notebook and pipeline patterns, and Unity Catalog governance - and get teams to actually adopt them.
 * Serve as the escalation point for complex Databricks failures, performance regressions, and cost anomalies, digging to root cause every time.
 * Turn every fix into something reusable - better defaults, templates, reference architectures, and automation instead of one-off patches.
 * Become the person teams check in with before they build, guiding responsible adoption of AI-assisted engineering practices along the way.