Senior Infra Architect@ Remote||San Francisco ,CA

1. Writing Spark jobs using PySpark
2. Integration with Azure Data Lake Storage (ADLS)
3. Azure Data Factory (ADF) pipelines

Job summary: Sr Consultant with seven to nine years of experience will architect and implement Azure and Azure Databricks solutions in a hybrid work model during day shifts, partnering with cross functional teams to deliver secure scalable analytics platforms that improve decision making, operational efficiency, and business outcomes for global enterprise clients.

Job Description/Responsibilities: Design & implement the Databricks delta sharing model across the board the affiliates Deploy Databricks Workspaces Onboard new applications to Databricks and help application teams to migrate Build & Configure Unity Catalogs Troubleshoot & Fix any access issues for App teams to Databricks workspaces Designing, developing, and Eligible to workimizing data pipelines and workflows. Familiar with Agile Methodologies Experience in Creation & Configuration of Azure Resources & RBAC Experience provisioning, securing and supporting teams building applications (operational, not application design) around these services: Chatbot Azure QnA service Azure cognitive search Azure Text Analytics Azure translator service

Experience Designing and deploying various other Azure Services Experience in resolving Issues with Azure Resource issues and troubleshooting Azure IaaS and PaaS services Understanding of Azure HA/DR patterns for these services Working knowledge of Azure networking, Azure Policy, scripting (bash / python), ARM templates, Linux Design and Develop Platform as a Service (PaaS) Solutions using different Azure Services. Years of Experience: 10.00 Years of Experience