Azure Databricks Engineer

The role involves building scalable data pipelines, implementing data quality frameworks, enabling secure data access, and supporting modern data platform initiatives using Azure-native technologies. The candidate will work closely with cross-functional onshore and offshore teams to deliver high-quality data engineering solutions and support AI-driven data initiatives within Databricks., * Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Databricks.

• Implement and manage data transformation, ingestion, replication, and CDC processes using PySpark, SQL, and related tools.
• Build and maintain robust Data Quality frameworks using DLT and DQX within Databricks environments.
• Manage secure handling of PII data through encryption/decryption mechanisms and secure service account access.
• Work extensively with Azure SQL and optimize database performance, queries, and data models.
• Configure and manage Azure security services including Azure Key Vault, Azure Entra ID, Azure RBAC, and Azure IAM.
• Support CI/CD implementation and deployment activities using Azure DevOps and DABS.
• Develop Databricks agents and work with Databricks AI-related components and capabilities.
• Collaborate effectively with global teams across development, testing, and production support activities.
• Ensure adherence to enterprise security, governance, and compliance standards.

Do you have experience in Spark?, We are looking for a highly skilled Azure Databricks Engineer with 8-10 years of overall IT experience and strong expertise in designing, developing, and managing enterprise-scale data solutions on Microsoft Azure. The ideal candidate should have a minimum of 5 years of hands-on experience working with Azure data engineering services, especially Azure Databricks and Azure SQL., * Strong hands-on experience with:

• Azure Data Factory
• Azure Databricks
• Azure SQL
• PySpark & SQL
• Data Quality frameworks (DLT & DQX)
• Azure Key Vault
• Azure Entra ID
• Azure DevOps
• DABS
• Azure RBAC & IAM

• Experience in Data Replication and CDC implementations using tools like Stelo or similar technologies.
• Strong understanding of cloud security, access management, and data governance.
• Experience with Databricks AI capabilities and agent creation.
• Excellent communication and coordination skills for working with distributed teams.

Preferred Qualification:

• Databricks Certification is mandatory.

4.04.0 out of 5 stars United States Hybrid work $60 - $70 an hour - Full-time

Aspire Systems is a $180+ million global technology services firm with over 4,900 employees worldwide, partnering with 275+ active customers. Founded in 1996, Aspire has grown steadily at a 19% CAGR since 2020. Headquartered in Singapore, we operate across the US, UK, LATAM, Europe, the Middle East, India, and Asia Pacific regions, with strong nearshore delivery centers in Poland and Mexico. Aspire has been consistently recognized among India's 100 Best Companies to Work For for 12 consecutive years by the Great Place to Work Institute., Aspire is built on deep expertise in Software Engineering, Digital Services, Testing, and Infrastructure & Application Support. We serve diverse industries including Independent Software Vendors, Retail, Banking & Financial Services, and Insurance. Our proven frameworks and accelerators enable us to create future-ready, scalable, and business-focused systems, helping customers across the globe embrace digital transformation at speed and scale. Why Join Aspire Systems Being an Aspirian means being part of a future-ready, global workplace where you will work on emerging technologies, collaborate with diverse teams, and contribute to meaningful digital transformation initiatives. We foster innovation, value diverse perspectives, and enable continuous learning and career growth - guided by our philosophy of "Attention. Always." Aspire also follows a hybrid work model, promoting flexibility, collaboration, and work-life balance. Learn more about Life at Aspire: https://www.aspiresys.com/careers/life-at-aspire Our Commitment to Diversity & Inclusion At Aspire Systems, we foster a work culture that appreciates diversity and inclusiveness. We understand that our multigenerational workforce represents different regions, cultures, economic backgrounds, races, genders, ethnicities, education levels, personalities, and religions. We believe these differences make us stronger and are committed to building an inclusive workplace where everyone feels respected and valued.