> Markdown version of [/jobs/ext/3895638-entry-level-ai-software-engineer](https://www.wearedevelopers.com/jobs/ext/3895638-entry-level-ai-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Entry Level AI Software Engineer - **Company:** IBM - **Location:** Durham, NC, United States - **Experience:** Starter - **Contract:** Internship / Graduate position - **Skills:** AI Evaluation, JavaScript (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Cloud Computing, Code Generation, Code Review, Computer Programming, Data Structures, Software Debugging, Distributed Systems, Memory Management, Python (Programming Language), Open Source Technology, OpenShift, Software Engineering, TypeScript, Enterprise Data Management, Multithreading, Large Language Models, Concurrency, Software Application Programming, Generative AI, Agentic-AI, Git, Containerization, Kubernetes, Apache Kafka, Free and Open-Source Software, Invoking Functions, Model Context Protocol, Stream Processing, OpenSearch, Docker, Microservices - **Published:** October 23, 2026 - **Apply:** https://www.dice.com/job-detail/0d8ad7d3-a2c5-44c5-b290-b35c945c0d7d ## About the Role High School Diploma/GED Preferred education Bachelor's Degree Required technical and professional expertise * Strong software engineering fundamentals, including data structures, algorithms, software design, and testing. * Proficiency in Python and experience building applications or services that integrate APIs. * Hands-on experience building an application or working prototype with LLMs. You can explain what you built, how you integrated the model, and how you tested its behavior. Experience may come from personal, academic, open-source, or internship projects. * A systematic debugging mindset: you can investigate failures, test assumptions, and reason about how application code, data, models, and underlying systems interact. * Ability to translate a problem into clear requirements, prompts, and testable acceptance criteria, and critically evaluate AI-generated code and responses. * Familiarity with Git, clear technical communication, and the ability to learn quickly and collaborate on a team. Preferred technical and professional experience * Experience in one or more of the following areas is a plus. You do not need experience with every technology listed. * AI agents and tool or function calling; retrieval-augmented generation (RAG), embeddings, vector databases, or Model Context Protocol (MCP). * Independent AI projects, open-source contributions, or experiments beyond assigned coursework that demonstrate initiative and thoughtful engineering decisions. * Additional programming experience in JavaScript/TypeScript or Go, and familiarity with distributed systems or microservices. * Operating system concepts such as concurrency, multithreading, and memory management; relational databases and SQL. * Cloud and container technologies such as Docker, Kubernetes, or OpenShift; observability, search, or real-time data processing tools such as OpenSearch or Kafka. * AI evaluation, anomaly detection, or experience measuring and improving model accuracy, latency, and reliability., Being an IBMer means you'll be able to learn and develop yourself and your career, you'll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background. Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do. Are you ready to be an IBMer?, IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship. ## Description As an Entry Level AI Software Engineer, you will work alongside experienced engineers to turn advances in large language models into useful software. Depending on your team, you could build an agent that helps diagnose system issues, connect AI to enterprise data and tools, or create a simpler way for developers to work with complex systems. Bring your ideas, experiment, and help take a feature from prototype through testing and refinement. What You'll Do: * Design, build, and test AI-powered features that address real developer and client needs, with guidance from experienced engineers. * Integrate LLMs, APIs, and enterprise data into applications, exploring agent workflows, tool calling, and retrieval where they fit the problem. * Write clear specifications and effective prompts, use AI development tools thoughtfully, and review and test the code they produce. * Evaluate AI behavior with realistic test cases, measure quality and performance, and improve how applications handle incorrect outputs and failures. * Debug across model interactions, application code, APIs, and underlying systems to understand root causes and build reliable solutions. * Collaborate through Git, code reviews, and technical discussions; document your work and iterate on feedback.