AI Software Engineer III

• Design, build, and maintain AI-driven backend services, APIs, pipelines, and application features.
• Design AI pipelines with secure data handling, PII/PHI protection, redaction, and access-control-aware processing.
• Design and implement document ingestion pipelines (PDFs, scans, images, email attachments).
• Design evaluation frameworks for extraction accuracy, retrieval relevance, and LLM output quality.
• Build document classification, entity extraction, and schema mapping workflows.
• Implement OCR and layout-aware extraction pipelines.
• Develop confidence scoring, human-in-the-loop workflows, and validation mechanisms.
• Build systems that route extracted data into downstream enterprise systems.
• Build connectors and ingestion pipelines for structured and unstructured systems (e.g., Confluence, file stores, databases).
• Implement chunking, indexing, and metadata enrichment strategies.
• Design retrieval strategies including hybrid search (vector + keyword).
• Improve relevance via ranking, filtering, and contextualization.
• Implement monitoring and observability for AI systems, including model performance, retrieval quality, extraction accuracy, and drift detection.
• Partner with Product, Data, and Architecture teams to translate business problems into efficient AI solutions.
• Participate in the design process to build efficient, scalable and maintainable architecture.
• Research, evaluate and recommend alternative solutions.
• Build scalable services integrating LLMs, retrieval systems, model inference endpoints, and third-party AI providers.
• Ensure solutions meet enterprise standards for reliability, security, compliance, and observability.
• Collect and analyze metrics to drive implementation decisions.
• Design, improve and document processes.
• Review and collaborate with other engineers on their code.
• Support your team through encouragement and by example.
• Mentor and share knowledge within the team and across the department.
• Deliver on personal and team deadlines and goals.

• Bachelor's degree in computer science, mathematics, engineering or another related field
• 6-8 years of professional experience in application development
• Comfortable working with multiple programming languages at the same time
• Strong proficiency in one more backend languages: Java, Python, Go, or Node.js - Python is strongly preferred
• Hands-on experience implementing AI features such as:
• Integrating LLM APIs
• Building embeddings, vector stores, or semantic search
• Fine-tuning prompt engineering for LLM-based systems
• Implementing Retrieval Augmented Generation (RAG) patterns
• Experience consuming or integrating machine learning models in production applications
• Experience with OCR and document AI platforms (Textract, Azure Form Recognizer, Google Doc AI, Tesseract, etc.)
• Understanding of structured data extraction from semi-structured documents
• Experience with schema mapping / data normalization pipelines
• Knowledge of confidence scoring, validation, and exception handling
• Familiarity with event-driven data pipelines
• Experience designing search systems or knowledge retrieval platforms
• Understanding of information retrieval concepts (ranking, recall, precision, indexing)
• Knowledge of document chunking and embedding strategies
• Familiarity with access control propagation in search systems
• Experience with monitoring ML/AI systems in production
• Understanding of model drift, data drift, and prompt performance tracking
• Experience handling sensitive data in AI workflows
• Understanding of data masking, redaction, or de-identification techniques
• Solid understanding of RESTful API design, microservices, and distributed systems
• Strong foundation in data structures, algorithms, concurrency, and performance optimization
• Familiarity with relational and NoSQL databases and performance considerations
• Experience with Agile development methodologies
• Strong communications and presentation skills
• Excellent organizational skills, detail-oriented, and works well in a team environment or as an independent contributor
• Ability to work with minimal supervision within a team environment
• Ability to think strategically and execute with urgency
• Desire to innovate and discover new technologies
• Driven to continually learn and master new skills

Preferred Skills/Experience:

• Experience working in regulated industries (healthcare, finance, insurance)
• Knowledge of governance frameworks around data privacy (HIPAA, SOC2, GDPR, etc.)
• Experience evaluating model performance, prompt effectiveness, and model drift
• Experience developing AI guardrails, moderation, hallucination-prevention, or safety patterns
• Extensive experience in web development using modern frontend and backend technologies
• Strong proficiency in frontend (React, NextJS) and backend (Python) technologies
• Work with responsive design frameworks
• Deployments to Amazon Web Services
• Proficiency in AWS services: EC2, S3, Lambda, RDS, CloudFormation/Terraform, ECS/EKS, VPC, IAM, etc.
• Caching and in-memory database technologies
• Asynchronous/multi-threaded programming patterns

Based on relevant market data and other factors, the anticipated hiring range for this role is $140 ,000 to $175 ,000 annually. Final compensation rates will be determined based on various factors, including but not limited to experience, skills, knowledge, and internal equity considerations. This role is also short-term incentive eligible. Incentive amounts will vary by individual and business goals. We are committed to fair and equitable compensation practices. The final salary offered to the selected candidate may vary from the posted range due to individual qualifications. Our goal is to ensure that all teammates are compensated fairly and competitively based on their contributions to our organization. RxBenefits is also committed to providing best in class benefits to our teammates. We offer a robust total rewards package that includes:

• Remote first work environment
• Choice of a HDHP or PPO Medical plan, we pay 100% of the premium for the HDHP for you and your eligible family members
• Dental, Vision, Short- and Long-Term Disability, and Group Life Insurance that we also pay 100% of premiums (for your family too on Dental and Vision)
• Additional buy-up options for Short- and Long-Term Disability and Life Insurance
• 401(k) with an employer match up to 3.5% available after 60 days
• Community Service Day to give back and support what you love in your community
• 10 company holidays including MLK Day, Juneteenth, and the day after Thanksgiving plus a floating holiday to use as you like
• Reimbursements for high-speed internet, we'll send you a computer and monitors to help you do your best work
• Tuition Reimbursement for accredited degree programs
• Paid New Parent Leave that can be used for adoption or birth
• Pet insurance to protect your furbabies
• A robust mental health benefit and EAP service through Spring Health to support you when you need it most