> Markdown version of [/jobs/ext/3049597-data-platform-architect-databricks](https://www.wearedevelopers.com/jobs/ext/3049597-data-platform-architect-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Platform Architect (Databricks)

- **Company:** Coast Professional, Inc.
- **Location:** Indianapolis, IN, United States
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Apache HTTP Server, Unit Testing, Cloud Computing, Cloud Engineering, Code Review, Customer Data Management, Data as a Services, Data Infrastructure, Data Integrity, Extract Transform Load (ETL), Data Loss, Apache Hive, Reference Data, Salesforce.Com, Data Streaming, Management of Software Versions, Snowflake, Apache Spark, Data Lakes, Pyspark, Data Management, Api Design, Restful APIs, Databricks
- **Published:** September 24, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=3adb2b649196d41a

## About the Role

* Databricks - hands-on with Delta Lake, Unity Catalog, and consuming / publishing data products; lakehouse / medallion architecture.
 * AI - hands-on experience applying AI in a data, integration, or software-development context.
 * Data services on AWS - hands-on experience building data and transformation services / pipelines on AWS.
 * API - hands-on REST API design, build, and implementation at scale.
 * PySpark - strong, hands-on PySpark and Spark SQL for data movement and transformation.
 * Master Data / MDM - hands-on experience integrating customer, account, and product master data into downstream systems, including schema mapping, reconciliation, and master-data change handling.
 * Demonstrated ability to lead a build team while remaining hands-on - doing the build, review, and deployment work directly.

## Description

Master Data sources (customer, account, and product master) are exposed as governed data products in Databricks - curated Delta tables registered in Unity Catalog. This role owns the consumption of those data products and their reliable, validated delivery into the target CRM and enterprise ecosystem, while re-platforming existing integrations onto modern, cloud-native patterns.

This is a working, hands-on leadership role. The person leads the integration workstream and personally performs the coding, code review, and deployment work - not oversight alone. Every skill listed is expected to be backed by direct, hands-on delivery experience., * Hands-On Integration Delivery

 + Personally perform coding, code review, and deployment activities, and any other assigned work related to this transformation - leading the team does not replace individual hands-on contribution.
 + Must have hands-on experience across all required skills; the person is expected to build, not only direct others who build.
 + Own the end-to-end integration lifecycle: design specification, build, unit testing, deployment across dev / sandbox / UAT / prod, runbooks, and knowledge transfer.
 + Produce design specifications, deployment steps, and rollback approaches, and deliver them hands-on.
 * Databricks Data-Product Consumption & Integration
 + Consume Databricks data products (Delta Lake tables via Unity Catalog) as the source of master data, respecting the data-product contract - schema, refresh cadence, quality guarantees, and access model.
 + Move master data from Databricks into the CRM using the appropriate pattern - Apache Iceberg interoperability, Spark / PySpark-based movement, or API-based delivery - selecting the right mechanism per integration by volume, latency, and directionality.
 + Build transformation and mapping logic (PySpark / Spark SQL) to reconcile the data-product schema with the target CRM data model, including handling master-data change (deltas, data-change requests, reference data).
 + Re-platform existing master-data integrations onto the Databricks-data-product and modern integration patterns, ensuring parity, reconciliation, and no data loss during transition.
 + Implement observability, data-quality checks, error handling, data-gap detection, and reprocessing across the Databricks-to-CRM flows.
 * Client Engagement & Meetings
 + Participate in and lead all relevant client meetings - design reviews, working sessions, governance forums, and status discussions - representing the integration workstream directly with the client.
 + Communicate technical decisions, risks, and dependencies clearly to client stakeholders and delivery teams.
 * Multi-Vendor (Dual-SI) Collaboration
 + Collaborate with the second System Integrator (SI) partner responsible for independently testing and validating this team's build.
 + Review the second SI's test findings, triage them, and resolve the defects - ensuring fast, clean cross-vendor root-cause and closure rather than back-and-forth.
 + Maintain clean build-to-test handoffs and shared traceability so defects are resolved efficiently across vendors.
 * On-Site Presence & Travel
 + Must be present in person in Indianapolis.
 + If not working from Indianapolis, must travel for all important meetings as required by the program.
 * Patterns, Standards & Data Partnership
 + Define reusable integration patterns and interface contracts for master-data flows that other build and assurance teams can work to.
 + Partner with data-product owners and data-engineering teams to align on data-product schemas, versioning, refresh frequency, access, and change management.
 + Ensure data integrity, security, privacy, and, where applicable, regulated-industry compliance across connected systems., * Remote flexible work; "Live by the beach, work in the Cloud," plus company office locations in Palm Coast, FL; Atlanta, GA; Tysons, VA & Lexington, KY; travel as required to client locations
 * Unlimited Paid Time Off (RTO), 401K with Company Match, and Medical, Vision, & Dental coverage
 * Competitive quarterly bonus opportunities
 * Continuing education and certification reimbursements, specifically within the Salesforce and Snowflake ecosystems; plus occasional in-house competitions with spot bonuses
 * A flexible and fun team culture! We value transparency, support, flexibility, growth, teamwork, fun, and so much more
 * Frequent team and culture activities, virtual & in-person, including Lunch and Learns, Happy Hours, team-building events
 * Monthly All-Hands calls to bring the company together, and an open-door leadership policy with access to mentorship and guidance
 * Opportunities for accelerated growth, networking, and career guidance and support
 * Trust, transparency and respect across all levels of the company


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow)
- [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge)
- [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)