Responsible AI, Lead Applied Scientist - X Delivery

Are you passionate about developing socially and ethically responsible AI systems? Are you excited by the prospect of supporting projects that apply cutting-edge AI and GenAI models to solve real-world problems? Imagine working with BCG's Responsible AI team, where you will develop and apply innovative tools for testing and evaluating new GenAI products. Your daily work would involve designing and implementing testing and evaluation frameworks to help improve product quality and ensure AI systems are safe, secure, and equitable.

Join a team dedicated to exploring creative solutions and pioneering advancements in Responsible AI. Your work will influence the development of GenAI applications, focusing on transparency, accountability, and trustworthiness. On the team, you'll collaborate with brilliant minds and make a tangible impact on shaping the future of AI, ensuring it meets the highest standards for responsibility and effectiveness. You will have the opportunity to support a wide variety of projects, spanning use cases, technologies, industries, and clients. Embrace the challenge of working at the intersection of cutting-edge technology, ethical innovation, and real-world applications.

The Responsible AI Applied Scientist plays a critical role supporting BCG's testing and evaluation efforts, working in conjunction with our AI and GenAI product teams to ensure alignment with our Responsible AI policy, principles, and standards, and to support the design, continuous improvement, and execution of the overall Responsible AI program at BCG.

The Responsible AI Applied Scientist will work with a diverse set of stakeholders to:

• Ensure responsible development of GenAI and AI products by providing Responsible AI expert support to GenAI and AI product teams, including conducting independent assessment of product-level risks and owning product evaluations

• Engage independently and directly with BCG product teams to support Responsible AI-related needs across the entire software development lifecycle of GenAI or AI products

• Work with and support technical teams executing risk assessment and testing and evaluation of GenAI and AI products

• Train and mentor technical teams on testing and evaluation approaches for GenAI products

• Remain up-to-date on emerging frameworks, standards, and technical approaches, and related issues, by participating in workshops, reading professional publications, maintaining personal networks, and participating in professional organizations

• 3-5+ years of experience in Responsible AI, including directly engaging with AI product teams

• 3+ years of industry experience in building or evaluating Generative AI models

• Experience in program/project management and team leadership

• Strong programming skills in Python and deep learning frameworks (PyTorch, TensorFlow)

• Demonstrable knowledge of Responsible AI issues, trends, frameworks, and best practices

• Working knowledge of emerging AI regulatory and legal frameworks across the globe

• Excellent written and verbal communication skills across technical and non-technical audiences

• Ability to explain sophisticated data science concepts to non-technical audiences and translate analytical results into business implications

• Ability to think critically about ethical, social, and business risks posed by GenAI and AI systems

• Passion for building things and comfort working with modern data science development tools

• Experience designing and analyzing experiments using advanced statistical methods

• Experience and enthusiasm for working with GenAI technologies Technical Skills Must-have experience:

• Advanced degree (MS or PhD) in Computer Science, Software Engineering, or equivalent research/work experience

• Strong research background in empirical evaluation, experimental design, or benchmarking

• Deep familiarity with software engineering workflows and developer tools

• Experience working with or evaluating AI/ML models, preferably LLMs

• Strong analytical and communication skills, including the ability to write clear testing result reports Nice-to-have experience:

• Experience with quantitative social science research

• Familiarity with software engineering practices (e.g., unit testing, CI/CD)

• Exposure to cloud platforms (AWS, Azure, GCP) or SQL databases

• Knowledge of AI risk management frameworks (e.g., NIST AI RMF)

• Experience with developer tools, including IDEs (e.g., VSCode, Pycharm) and environment management (e.g., Pyenv, Conda, Poetry, Docker)

• Demonstrable contribution to open-source evaluations of GenAI

Who You'll Work With

You'll work in a fast-paced, intellectually challenging, product-oriented environment where we advance our thinking about and operationalization of Responsible AI. You'll engage with a diverse set of stakeholders, including senior executives, AI and GenAI product teams, legal, compliance, and security teams, BCG's Chief AI Ethics Officer, the Director of the Responsible AI team, and other members of the Responsible AI team.

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures-and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive. We Are BCG X We're a diverse team of more than 3,000 tech experts united by a drive to make a difference. Working across industries and disciplines, we combine our experience and expertise to tackle the biggest challenges faced by society today. We go beyond what was once thought possible, creating new and innovative solutions to the world's most complex problems. Leveraging BCG's global network and partnerships with leading organizations, BCG X provides a stable ecosystem for talent to build game-changing businesses, products, and services from the ground up, all while growing their career. Together, we strive to create solutions that will positively impact the lives of millions. We Are BCG X We're a diverse team of more than 3,000 tech experts united by a drive to make a difference. Working across industries and disciplines, we combine our experience and expertise to tackle the biggest challenges faced by society today. We go beyond what was once thought possible, creating new and innovative solutions to the world's most complex problems. Leveraging BCG's global network and partnerships with leading organizations, BCG X provides a stable ecosystem for talent to build game-changing businesses, products, and services from the ground up, all while growing their career. Together, we strive to create solutions that will positively impact the lives of millions.