USA_Developer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Requirements
We are seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills, the ability to work independently, and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders.
Expertise in: Azure Databricks, PySpark, Delta Lake Azure Data Factory (ADF) and ADLS Gen2 Experience working on large-scale, cloud-native data platforms (Azure preferred) Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
Strong experience building REST or GraphQL APIs Experience with Kubernetes (AKS preferred) for API deployment Understanding of API security, contracts, error handling, and performance
Strong understanding of data governance, security, and CI/CD practicesPrimary skill for the API Role with AI Builder
| Associate should have handson knowledge in Databricks | ADF | pyspark | Also must have knowledge of cloud |
Skills: Digital : Scala~Digital : Databricks~Digital : PySpark~Azure Data Factory
Experience Required: 4-6 years Skills:CategoryNameRequiredImportanceExperienceSkillCategoryTest1_MNAzure Data FactoryYes1>7 years SkillCategoryTest1_MNDatabricksYes1>7 years SkillCategoryTest1_MNDigital : Azure DatabricksYes1>7 years SkillCategoryTest1_MNDigital : PySparkYes1>7 years SkillCategoryTest1_MNDigital : ScalaYes1>7 years
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦