> Markdown version of [/jobs/ext/4458489-ai-ml-software-engineer](https://www.wearedevelopers.com/jobs/ext/4458489-ai-ml-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI ML Software Engineer - **Company:** ZIO Technologies - **Location:** United States (Remote available) - **Experience:** Experienced - **Contract:** Temporary contract - **Skills:** Clean Code Principles, Application Programming Interfaces (APIs), Artificial Intelligence, Apache HTTP Server, Software Code Optimization, Content Analysis, Data Mining, Data Structures, Relational Databases, Document Management Systems, Web Development, Distributed Systems, Middleware, Graph Database, Design of User Interfaces, Information Retrieval, Python (Programming Language), PostgreSQL, Machine Learning, Language Modeling, Neo4j, Remote File Sharing, Search Technologies, Service-Oriented Architecture, Software Engineering, Software Systems, SQL Databases, Systems Integration, Data Processing, Chatbots, ReactJS, Evaluation Pipelines, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Model Validation, HybridCloud, Backend, Agentic-AI, Git, Build Management, Containerization, Integration Tests, Information Technology, Low Latency, Low-code, Operational Systems, Machine Learning Operations, Tools for Reporting, Virtual Agents, Api Design, Graph RAG, Software Version Control, Data Pipelines, Docker, Programming Languages - **Published:** October 5, 2026 - **Apply:** https://www.dice.com/job-detail/3c8bd11f-2e33-4ef7-8b78-cb485900582e ## About the Role * Bachelor of Science in Engineering, Computer Science, Data Science, or Mathematics, or a related field Preferred Qualifications * At least three (3) years' experience in data science, machine learning, or applied AI development * At least three (3) years' experience in software engineering, architecture, or web development Required Skills, Experience, & Capabilities Technical Experience * SQL and relational database systems (e.g., PostgreSQL) * Fine-tuning small language models or embedding models * Graph databases or graph extensions (e.g., Neo4j, Apache AGE) * Designing and implementing multi-agent or task-oriented AI systems * Embedding models, vector similarity, re-ranking, and graph retrieval techniques in RAG systems * Version control systems (e.g., Git), containerization technologies (e.g., Docker), and service-oriented architectures * Collaborating with large language models (LLMs), including both API-based integration and local deployment * Validating AI-generated outputs, mitigating hallucinations, and integrating AI tools into production pipelines Core Engineering Capabilities * Strong proficiency in Python, including backend services, APIs, middleware, and data pipelines * Understanding of data structures, algorithms, and clean coding principles * Ability to select and apply appropriate techniques (LLM and non-LLM) * Ability to design and implement AI/ML systems operating on complex, inconsistent, or evolving datasets while balancing accuracy, latency, and cost Additional Knowledge Areas * Hybrid cloud environments and distributed system considerations * Threading, asynchronous processing, and queues in backend systems * React and chatbot UI development * Classical natural language processing (NLP) techniques in addition to LLM-based approaches * Data science and LLM-related libraries in performance-oriented programming languages Work Environment & Requirements * Work is primarily remote within the United States * Must be available Monday through Friday, 8:00 AM to 4:30 PM EST * Flexibility to support evenings, weekends, or extended hours as needed * Must be able to report onsite within seventy-two (72) hours if required * Initial onboarding may require onsite presence Security & Compliance Requirements * Must use approved technologies for all work * No use of personal devices to access systems * No external file sharing outside approved environments ## Description ZIO Technologies is seeking a highly skilled AI/ML Software Engineer to support a long-term AI/ML initiative focused on building intelligent systems that automate tasks, enhance internal workflows, and improve user-facing services. Scope of Work The AI/ML Software Engineer will: * Build software tools that incorporate AI/ML techniques to automate narrowly defined tasks with high accuracy * Assist internal users with their job functions * Improve the experience external users have when interacting with systems This includes, but is not limited to: * RPA work * Building or refining chatbots * Incorporating AI/ML into reporting tools * Building LLM agents for knowledge retrieval, deep research, translation, transcription, redaction, document analysis, document generation, agentic coding, and data processing Key Responsibilities System Design & Collaboration * Work within established constraints regarding infrastructure, programming languages, and model selection * Contribute to technical decision-making related to data processing, retrieval strategies, and system integration * Collaborate with team members to define agent architectures, workflows, and system design decisions * Evaluate and select appropriate approaches for given tasks, including determining when to use LLM-based versus non-LLM techniques * Design and build software systems that integrate AI/ML techniques Testing, Evaluation, and Quality Assurance * Assist in the design and implementation of testing and evaluation pipelines for AI/ML systems * Develop unit and integration tests for AI-enabled workflows and data pipelines * Generate and utilize synthetic data to support evaluation and benchmarking efforts * Contribute to improving system performance, including accuracy, latency, and cost efficiency Deployment & Operations * Support deployment of AI/ML applications within a hybrid cloud environment * Work with containerized applications to ensure reliable deployment and updates * Optimize systems for environments with limited computational resources, including minimal GPU availability General Responsibilities * Deliver production-grade systems aligned with defined requirements * Document system designs, workflows, and technical decisions * Stay informed on relevant advancements in AI/ML and apply them where appropriate What You'll Work On (Multi-Year Deliverables) This role supports a multi-year AI/ML roadmap. Key initiatives include: Year 1 * Internal chatbot refinement (UI improvements, user history, feedback) * External chatbot development (conversational, user-facing) * RPA tools using local LLMs and batching * Knowledge retrieval improvements (RAG, vector search, system integration) * AI capabilities for translation, transcription, and redaction Year 2 * Chatbot personalization and workflow integration * RPA automation with reporting and analytics * Expanded knowledge retrieval with permission-based indexing * Deep research capabilities using graph-based retrieval (graphRAG) * Document analysis using NLP and graph techniques Year 3 * Scaling chatbot systems for broader deployments * Case management integration and data centralization * Advanced automation for case review and updates * Structured data extraction from documents * Initial document generation (PDFs, forms) Year 4 * Low-code AI agent builder for internal use * Workflow-integrated chatbot systems * AI-enhanced reporting and automation expansion * Fine-tuning embeddings and small language models * Expanded document and content generation capabilities Year 5 * Public-facing AI retrieval capabilities * Integration of transcription into operational systems * Advanced document modification using AI and automation