> Markdown version of [/jobs/ext/3699776-ai-ml-software-engineer](https://www.wearedevelopers.com/jobs/ext/3699776-ai-ml-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI/ML Software Engineer

- **Company:** Gallatin Inc
- **Location:** United States
- **Contract:** Permanent contract
- **Skills:** Training Data, Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Artificial Neural Networks, C++ (Programming Language), Nvidia CUDA, Computer Programming, Information Engineering, Interaction Design, Python (Programming Language), Machine Learning, Open Source Technology, Performance Tuning, Tensorflow, Data Streaming, Jupyter Notebook, Data Processing, Pytorch, LangChain, Open-source Models, Large Language Models, Grafana, Prompt Engineering, Generative AI, Pandas, Build Management, Real-time Inference, HuggingFace, Apache Kafka, Machine Learning Operations, Kibana, Legacy Systems
- **Published:** October 12, 2026
- **Apply:** https://startup.jobs/ai-software-engineer-gallatin-10373523

## About the Role

* Strong Programming Skills
 + Expertise in at least one: Python, C++, or C.
 * ML Framework Proficiency
 + Hands-on experience with AI/ML training and fine-tuning frameworks, including:
o PyTorch, TensorFlow, CUDA, Jupyter Notebooks
o Large Language Models (LLMs) and Open-Source Models (Llama, Anthropic, Mistral)
o LangChain, Retrieval-Augmented Generation (RAG), Hugging Face, Exo Labs

 * MLOps & Data Engineering Knowledge
 + Experience with data processing and pipeline frameworks such as Apache Kafka, Apache Airflow, AWS Kinesis, pandas, and dbt.
 + Understanding of AI model performance monitoring, data drift detection, and observability tools like Grafana or Kibana.
 * AI Fundamentals & Security Awareness
 + Deep understanding of deep neural networks (DNNs), LLMs, over/underfitting, prompt engineering, and LLM security (jailbreaking risks and protections).
 * Growth Mindset
 + A passion for continuous learning, staying current with the latest advancements in AI/ML, and teaching others, * Experience mentoring and upskilling junior engineers.
 * Familiarity with legacy systems and working with public sector customers.
 * Contributions to open-source (AI/ML) projects.

## Description

We're looking for an AI/ML Software Engineer to play a foundational role in building and deploying AI-powered solutions for our core product. You'll work across the full AI/ML lifecycle, from defining and building models to evaluating and deploying large-scale ML pipelines and real-time inference systems, while partnering with cross-functional teams to deliver impactful, real-world AI applications., + Validate AI-driven product features through real-world testing and feedback from warfighters.

 + Establish scalable MLOps pipelines and real-time inference services to streamline model training, deployment, runtime, and monitoring.
 + Own high model reliability and uptime by implementing monitoring across your work.
 * Data Collection & Processing
 + Identify and integrate structured, unstructured, batch, and real-time data sources.
 + Work with internal logs, APIs, user interactions, and third-party datasets to improve training data quality.
 * Continuous Improvement & Best Practices
 + Stay ahead of emerging AI trends and technologies to improve model performance.
 + Document and share AI/ML development best practices.
 + Contribute to the hiring and mentoring of AI/ML talent as we grow our team.
 + Help the wider team understand the latest trends and the significance of novel approaches in AI.