Data and Applied Scientist II

The Copilot Search Multimedia Index Selection team is looking for a Data and Applied Scientist II to help build the next generation platform for Bing and Microsoft AI.Our mission is to construct the most comprehensive, rich, clean, diverse, and fresh image index that serves as the foundation for image-related experiences across Microsoft. We develop advanced AI and machine learning solutions for image content discovery, selection, ranking, and processing to improve the quality and relevance of our multimedia products.Maintaining a comprehensive, diverse, and up-to-date image index presents unique technical challenges. We continuously innovate to improve quality, scalability, and efficiency while supporting billions of images and balancing performance, freshness, cost, and latency requirements.Some of the key challenges you will work on include:Image Content Discovery: Developing approaches to efficiently discover and understand image content across the web.Machine Learning for Selection and Ranking: Building, training, and evaluating machine learning, deep learning, and multimodal models for content understanding, selection, and ranking using both text and image signals.Freshness and Real-Time Systems: Contributing to data pipelines and models that support near real-time indexing and content freshness.AI-Powered Platform Innovation: Exploring and implementing new AI capabilities that improve platform intelligence and operational efficiency.This is an exciting opportunity for someone who enjoys solving challenging technical problems using data, machine learning, and AI. In this role, you will collaborate closely with scientists, engineers, and product teams to develop and deploy production-ready solutions. You will conduct experiments, analyze large-scale data sets, build and evaluate machine learning models, and translate insights into impactful improvements for Microsoft AI products.As a Data and Applied Scientist II, you will apply statistical, machine learning, and deep learning techniques to analyze and interpret multimodal content, develop features and models that improve system capabilities, and help scale AI solutions to large-volume production environments. You will contribute to advancing state-of-the-art approaches while delivering measurable impact to products used by millions of customers.

Responsibilities

• Develop expertise in relevant machine learning, deep learning, and multimodal AI techniques, and apply them to solve challenging problems in image indexing, content understanding, selection, and ranking.
• Partner with scientists, engineers, and product managers to understand business and product requirements, translate them into data-driven solutions, and deliver measurable product impact.
• Design, implement, and evaluate machine learning and deep learning models, including Large Language Models (LLMs), Small Language Models (SLMs), and multimodal models for document understanding, content discovery, parsing, clustering, selection, and ranking.
• Conduct large-scale data analysis and experimentation to identify opportunities for improving image index quality, freshness, relevance, and diversity.
• Develop robust evaluation methodologies and analyze experiment results to drive model improvements and support data-informed decision making.
• Contribute to near real-time indexing systems and AI-powered platform capabilities that improve multimedia content discovery and user experiences.
• Work with petabyte-scale datasets and Big Data technologies to build, validate, and optimize machine learning solutions for production environments.
• Document experiments, model performance, methodologies, and key learnings, and communicate findings effectively with teammates and stakeholders.
• Follow responsible AI, privacy, security, and data governance best practices throughout the model development lifecycle.
• Collaborate across Microsoft with engineers, scientists, and product teams to develop, deploy, and operate scalable AI solutions that serve billions of multimedia documents.
• Stay current with advancements in machine learning, deep learning, generative AI, and multimodal systems, and apply relevant innovations to improve product capabilities.
• Contribute to the delivery of state-of-the-art models and data-driven features that enhance the Microsoft AI Multimedia Index platform.

• Bachelors Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
• OR Masters Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field
• OR equivalent experience., * Bachelors Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 5+ years related experience (e.g., statistics, predictive analytics, research)
• OR Masters Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
• OR equivalent experience.
• Solid machine learning / computer vision / natural language processing experience and results in academy or industry. Publications in major ML/IR/NLP/CV conferences. Examples: ICML, NIPS, SIGIR, ACL, EMNLP, CVPR, KDD.
• Experience in open source (spark, hbase, hadoop etc) or microsoft internal tech (cosmos, autopilot, azure) are big plus as well as most of our project/scenario is across system and AI areas.
• Good communication skills and ability to work in collaborative environment.
• Good design and problem-solving skills and an ability to innovate and solve challenging technical problems.
• Passion and self-motivation.
• Embrace engineering excellence and delivering quality results at scale., Analysis Skills, Apache HBase, Apache Hadoop, Apache Spark, Artificial Intelligence (AI), Best Practices, Big Data, Communication Skills, Computer Engineering, Computer Science, Computer Vision, Conferences, Content Indexing, Continuous Improvement, Data Analysis, Data Management, Data Modeling, Data Sets, Deep Learning, Develop Methodologies, Diversity, Documentation Models, Econometrics, Electrical Engineering, Equipment Selection, IR (Infrared), Image Indexing, Industry/Trade Press, Integrated Circuits (ICs), Machine Learning, Microsoft Bing Search Engine, Microsoft Product Family, Microsoft Windows System Internals/Programming, Modeling Languages, Multimedia, Natural Language Processing (NLP), Open Source, Operational Strategy, Performance Modeling, Predictive Modeling, Privacy Controls, Problem Solving Skills, Process Improvement, Product Lifecycle, Production Systems, Production Volume, Quality Management, Statistics, Team Player, Technical Presentation, Training Data Sets, User Interface/Experience (UI/UX)

Everyone works differently and is motivated by different things. We also understand that there’s more to you than your job. That’s why we offer competitive pay and a wide assortment of benefits– to help you make the most of life at work and away from it.

Microsoft Corp DO WHAT YOU LOVE Make your mark on the world’s most used technologies. Develop the next hit mobile application. Pioneer a startup that could be the next big thing. At Microsoft, you choose your path.

Headquartered in Redmond, Washington, Microsoft is a top innovator in both the consumer and enterprise technology industry. Just a few of the many things our products do are unleash creativity, connect businesses, and make learning more fun. But our continued success is based on one thing: our employees. We hire amazing, talented people and give them the opportunities-and the tools-to succeed.

WHY MICROSOFT? As a Microsoft employee, you’re surrounded by a diverse group of the smartest people in your field. This fosters new ideas, better business results, and creates a dynamic work environment. In the office, you’re constantly challenged and supported by your colleagues. Every day holds something new and exciting.

We also offer unparalleled depth and breadth of career opportunities. As an industry leader in multiple fields, working for Microsoft means being able to do whatever you feel passionate about-and being able to make an impact in that field. From day one, we give our employees significant responsibility. This means that you’ll know that you directly contributed to something that has a positive impact on people worldwide. Whether you choose to work in management, dive deep into the newest technology, or explore multiple professions, you’ll find everything you need at Microsoft to drive your career-and to make a difference.