Data Engineer II

Microsoft
Redmond, United States of America
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 202K

Job location

San Francisco, United States of America

Tech stack

Business Analytics Applications
Data analysis
Azure
Microsoft Online Services
Program Optimization
Continuous Integration
Information Engineering
DevOps
Hive
Microsoft Data Access Components
Microsoft Software
Azure
System Availability
Spark
GIT
Microsoft Fabric
PySpark
Azure
Databricks

Job description

Within Azure Data, the Microsoft Fabric platform team builds and maintains the operating system and provides customers a unified data stack to run an entire data estate. The platform provides a unified experience, unified governance, enables a unified business model and a unified architecture.

Within Microsoft Fabric platform team, the Insights and Analytics team is dedicated to building and maintaining internal analytics and reporting platform hosted on Microsoft Fabric. This platform delivers insights to Azure Data Engineering team leaders, Product Managers, Marketing, Finance and Sales. Additionally, the team serves as the initial customer of newly developed products and features, running them in a production environment and collaborating closely with product managers and engineers to provide invaluable feedback. The Data Engineering team within the Azure Data Insights and Analytics organization is primarily tasked with maintaining and advancing our data platform. This platform encompasses Spark development, with a significant emphasis on PySpark and Spark SQL within Microsoft Fabric notebooks. Our team places high importance on code optimization, metadata-driven orchestration, and implementing best practices in DevOps.

We are seeking a skilled Data Engineer who can enhance our platform using modern technologies while ensuring reliable and high-performance operations. You will have the autonomy to define your area of expertise and cultivate skills that will propel your career forward. Your daily routine will include participating in standup meetings, managing work items based on your capacity, collaborating with the team's Program Managers to define new projects or initiatives, and, most importantly, engaging in development activities. In addition to traditional Data Engineering tasks, you will directly interact with the teams developing the tools we utilize, enabling you to provide direct product feedback and witness your input driving changes in the products over time. Our team is dedicated to reporting on the health of Azure Data products and contributing to their overall effectiveness and utility.

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Responsibilities Extract and transform disparate data into actionable insights that will drive business decisions. Applying industry best practice transformation and modeling techniques - validating the output to ensure reliable and accurate results for consumption by downstream data teams, and end users. Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies available to us. Contribute to the success of Azure Data by trying out and testing new products and features, contributing to the design of major feature enhancements, and dedicating time to provide direct feedback to the Product Group. Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver working proofs of concept, and develop final data solution. Live site and on call DRI duty for maintaining high availability of our analytics solutions . Collaborate with your peers and maintain flexibility on domain ownership as business priorities evolve. Work with other data teams within Microsoft on understanding their data products and onboarding them.

Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: *

  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications :- Intermediate knowledge and experience with Microsoft data tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, and Azure Databricks Intermediate knowledge and experience with GIT operations and CICD flows Advanced experience using a work management tool such as Azure DevOps Advanced experience in time management and prioritization Excellent written & verbal communication skills Passion for data and the desire to learn & adopt new technologies

About the company

Microsoft is a global technology company headquartered in Redmond, Washington. Our mission is to empower every person and every organization on the planet to achieve more. We develop, license, and support a wide range of software products, services, and devices that help individuals and businesses realize their full potential.

Our flagship products include the Microsoft 365 productivity cloud, Windows operating system, Azure cloud platform, and Dynamics 365 business applications. We are also a leader in areas such as artificial intelligence, cybersecurity, developer tools, and gaming through Xbox and Game Pass.

With operations in more than 190 countries and over 220,000 employees worldwide, Microsoft is committed to responsible innovation, inclusive economic growth, and sustainability. We work closely with governments, industries, and communities to ensure that technology serves the public good and helps address some of the world’s most pressing challenges.

As we celebrate our 50th anniversary in 2025, we continue to look forward—investing in AI, cloud, and quantum computing to shape the future of work, education, and society at large scale.

Apply for this position