Senior Data Platform Engineer- Databricks

PamTen
New York, NY, United States
5 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Continuous Integration Data Governance Data Infrastructure Data Systems Python (Programming Language) Power BI Standard Sql Claude Code Agentic-AI Integration Frameworks
+3 more
Api Design Terraform Databricks

Job description

  • Design, build, and enhance platform capabilities within Databricks and related technologies.
  • Build reusable data products and self-service capabilities.
  • Design and maintain data pipelines and integration frameworks.
  • Improve data quality, reliability, lineage, and monitoring.
  • Accelerate research-to-production delivery: prototype solutions alongside researchers; establish patterns that make productionization easier and faster; reduce friction between research and engineering workflows.

Requirements

Must have

  • 10 years of platform and data solutions experience
  • Hands-on Databricks experience (workspace, notebooks, jobs) and building platform capabilities
  • Python
  • SQL
  • Modern CI/CD, IaC (Terraform strongly preferred)
  • Data Governance and observability (Unity Catalog, lineage, monitoring)
  • Orchestration (Airflow)
  • AI fluency: use of AI agents (Claude Code preferred) as a primary tool to design, build, test, and support solutions

Nice to have

  • Financial domain experience, especially quant research
  • API development
  • PowerBI

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…