Databricks API Developer

The Intersect Group
Greenville, SC, United States
14 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) User Authentication Automation of Tests Microsoft Azure Code Review Continuous Integration Data as a Services Information Engineering Data Structures JSON Python (Programming Language) Key Management
+28 more
OAuth Parsing Standard Sql Runbook Simple Object Access Protocol (SOAP) Tableau (Software) Management of Software Versions Web Services Description Language Extensible Markup Language (XML) Openapi Data Logging Cloud Monitoring SOAPAPI Rate Limiting Git Data Lakes Pyspark Enterprise Integration Graphql Machine Learning Operations Restful APIs Integration Monitoring Pagination Data Pipelines Api Management Serverless Computing Databricks Web Api

Job description

  • Design, build, and publish APIs using Databricks Apps, Model Serving endpoints, Azure Functions, or Azure API Management.
  • Develop production-grade Python notebooks and Databricks Jobs that consume REST, GraphQL, and SOAP APIs.
  • Implement authentication, pagination, rate limiting, retries, timeouts, idempotency, and incremental data loads.
  • Parse and normalize JSON and XML/WSDL payloads into Delta tables using bronze, silver, and gold data structures in Unity Catalog.
  • Create API specifications, versioning standards, and documentation for API consumers.
  • Implement structured logging, audit tables, health checks, SLAs, and alerting for integration monitoring.
  • Build operational dashboards in Databricks SQL or Tableau to track failures, data latency, and integration health.
  • Develop reusable Python modules, automated tests, CI/CD deployments, runbooks, and secure access controls.

Requirements

  • 3-5 years of hands-on data engineering or integration development experience, including at least 2 years working with Databricks.
  • Strong Python skills, including experience with requests or httpx, SOAP libraries such as zeep, and a GraphQL client.
  • Experience with asynchronous or concurrent API calls.
  • Proven experience building and deploying production APIs consumed by other teams or external partners.
  • Hands-on experience consuming REST, GraphQL, and SOAP APIs, including OAuth 2.0 flows and token refresh.
  • Experience building monitoring and alerting for data pipelines or APIs, including alerts, dashboards, or runbooks.
  • Solid PySpark and SQL skills, with working knowledge of Delta Lake and Unity Catalog.
  • Experience with Azure Key Vault, Azure Functions, Azure API Management, Azure Storage, Azure Monitor, Git, CI/CD, and code reviews.

Apply if you have the Databricks, Python, API integration, and monitoring experience required to build reliable data services. This is a 3-month contract opportunity with a hybrid work arrangement in Greenville, South Carolina.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…