> Markdown version of [/jobs/ext/4638341-principal-software-engineer-ai-engineering](https://www.wearedevelopers.com/jobs/ext/4638341-principal-software-engineer-ai-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Software Engineer - AI Engineering

- **Company:** Context Labs
- **Location:** Cambridge, MA, United States
- **Experience:** Expert
- **Salary:** $170,000 - $235,000
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Code Review, Databases, Relational Databases, Java Virtual Machine (JVM), Spring Framework, PostgreSQL, Language Modeling, MySQL, NoSQL, Performance Tuning, Software Engineering, Software Systems, Systems Integration, Web Services, Chatbots, Retrieval-Augmented Generation, Large Language Models, Kubernetes, Information Technology, Functional Programming, Api Design, Software Coding, Software Version Control, Docker, Microservices
- **Published:** November 8, 2026
- **Apply:** https://www.juju.com/job/16_9146bb4a3

## About the Role

* 10+ years of experience in professional software systems development
 * Great communication skills
 * Big picture orientation with strong attention to detail
 * Comfort in dealing with highly abstract concepts and complex architectures is critical for this role.
 * Proven experience in integrating and utilizing LLM APIs for building conversational AI and machine-driven insight systems.
 * Demonstrated ability to fine-tune pre-trained language models (LLMs) to improve performance on specific tasks.
 * Proficiency in designing and optimizing prompts to elicit desired responses from language models.
 * Experience with integrating API services.
 * Proficiency in unit and functional testing
 * Hands-on experience in building and deploying conversational AI systems, including chatbots and virtual assistants.
 * Strong coding skills in Java or other JVM languages (e.g., Scala) for developing scalable AI solutions.
 * Experience with disparate Java frameworks such as Spring/Quarkus/Helidon etc.
 * Proficiency with Docker based microservice architectures and the Kubernetes platform.
 * Proficiency with MySQL, PostgreSQL, or equivalent RDBMS
 * Experience with NoSQL/NewSQL databases.
 * Proficiency in source code management

Preferred Experience:

 * Experience with functional programming
 * Experience with OpenAI API
 * A bachelor's degree in computer science or related field

## Description

Context Labs is seeking a Principal Software Engineer to help drive forward our AI Engineering initiatives within our ImmutablyTM Platform and analytics spaces. Working as an integral leader within the development team, the engineer will lead many aspects of developing our AI engineering systems; as well as provide thought leadership, upskilling of less senior engineers, and taking part in defining strategic linkages across the company's products. This role will report to the VP, Engineering.

In this role you will:

 * Provide leadership within the AI engineering team as a technical authority on AI, LLMs, and related technologies.
 * Develop and maintain AI integrations, systems, and services for use within the Immutably Platform.
 * Collaborate with other development teams and the product owner to define and estimate business requirements and then translate these into specific software tasks.
 * Develop code to translate business requirements into model execution.
 * Fine tune models to support specific business cases.
 * Develop RAG systems to support business requirements.
 * Provide exemplary designs, architecture, and code, etc. for the engineering team to use as guidelines.
 * Conduct code reviews
 * Lead technical talks on topics relating to building, scaling, and performance of AI systems.
 * Oversee the ongoing maintenance of related AI based systems.
 * Collaborate as a member of an agile team to get products developed and completed with best-in-class software development.
 * Coach and mentor members of your team through the variety of technological, and methodological challenges they face day-today.
 * Coordinate across a distributed team spanning multiple time zones.
 * Anything else as may reasonably be required by the company.