Data Architect
Role details
Job location
Tech stack
Job description
- Design modern lakehouse architectures on Databricks using Delta Lake, medallion patterns, and scalable data models.
- Lead technology consulting engagements and enterprise data modernization initiatives, define target-state architectures, and provide architectural leadership across transformation programs.
- Build and govern batch and streaming data pipelines using Auto Loader, Structured Streaming, and Delta Live Tables.
- Partner with client stakeholders to establish governance, security, lineage, and data quality controls using Unity Catalog and enterprise standards, aligning platform decisions to measurable business outcomes.
- Provide cross-functional leadership across engineering, architecture, and client teams, translating technical strategy into business value, prioritizing delivery against client objectives, and driving adoption of modern data and AI capabilities.
- Own service delivery responsibilities across client engagements by aligning architecture and execution to committed outcomes, managing delivery quality and governance, and ensuring solutions are implemented effectively from design through rollout.
- Drive AI-led development for the Databricks Data Intelligence Platform by building model-ready data foundations, metadata-rich architectures, vector-ready pipelines, and retrieval patterns that accelerate intelligent applications and modern data use cases.
- Lead production-grade AI implementations using Python and PyTorch to enable intelligent platform capabilities, secure deployment patterns, operational resilience, and scalable performance across modernization programs.
- Define and implement security guardrails, prompt safety controls, and evaluation/review frameworks to support responsible, measurable, and production-ready AI development on the Databricks Data Intelligence Platform across client engagements.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
- 10+ years of experience in data architecture, data engineering, or enterprise data platform design.
- Hands-on expertise in Databricks, Spark/PySpark, SQL, Python, PyTorch, and cloud data platforms.
- Strong experience in data modernization, migration, governance, performance optimization, and enterprise architecture for client-facing delivery.
- Proven experience enabling AI-driven development, ML workflows, and model lifecycle management, including production implementations with security guardrails and evaluation/review frameworks.
- Excellent stakeholder communication and cross-functional leadership skills.
Nice to Have
- Master's degree or advanced certification in data, cloud, AI, or intelligent platform engineering disciplines.
- Experience with Azure Databricks and one or more major cloud platforms (AWS or GCP).
- Knowledge of vector databases, intelligent application patterns, platform governance, and frameworks for guardrails, response quality evaluation, and human review.
- Experience with CI/CD, Infrastructure as Code, observability, and DataOps/MLOps practices.
Benefits & conditions
Pay Range Minimum: $128,000/Annual
Pay Range Maximum: $282,000/Annual Compensation and Benefits
A candidate's pay within the range will depend on their work location, skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the followi14520ng benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year.