Mid-Senior Data Engineer specialized in Azure Databricks
Role details
Job location
Tech stack
Job description
Lakehouse architectures using Delta LakeDevelop ETL/ELT pipelines orchestrated through Azure Data FactoryIntegrate data from multiple sources into the data platform and analytical layersDesign and maintain data models and data warehouse structures for analyticsEnsure data quality, scalability, and performance of large-scale data processing pipelinesCollaborate with BI teams to support Power BI and reporting platformsSupport and evolve existing SQL Server data platforms and ETL solutions (SSIS) when requiredContribute to the design of modern cloud-based data architecturesQualifications3+ years of experience in Data Engineering or Data Warehouse developmentStrong experience with Azure DatabricksExperience developing data pipelines using Py Spark and Spark SQLSolid understanding of distributed data processing and big data conceptsExperience working with Delta Lake and Lakehouse architecturesStrong SQL skills and experience with SQL Server relational databasesExperience building data pipelines
Requirements
using Azure Data FactoryExperience handling large datasets and performance optimizationNice to haveExperience with Spark optimization techniques (partitioning, caching, cluster tuning)Experience with structured streaming in DatabricksKnowledge of CI/CD pipelines for data platforms (Azure Dev Ops)Familiarity with Power BIExperience in migrating from traditional ETL process to cloud architecturesSoft SkillsStrong analytical and problem-solving skills.Ability to work in collaborative environments and to adaptCommitted to continuous learning and professional development, with a keen focus on advancing cloud computing expertiseTeam playerGood communication skills with technical and non-technical rolesIs proactive rather than reactive, actively identifying improvements and proposing solutionsIs comfortable working in dynamic environments where priorities and technologies evolveAdditional Information We offer:Culture of Relentless Performance: join an unstoppable technology development team with
Benefits & conditions
a 99% project success rate and more than 30% year-over-year revenue growth.Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.Work From Anywhere Culture: make the most of the flexibility that comes with remote work.Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices