AI Engineer

Falcon
Los Angeles, CA, United States
2 days ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Application Programming Interfaces (APIs) Artificial Intelligence Business Logic Audit Trail Automation of Tests Big Data Encodings Cyber Security Continuous Integration Data Validation Information Engineering
+22 more
Information Leak Prevention Information Retrieval Key Management Machine Learning Metadata Modular Design Regression Testing Cloud Services Secure Coding Software Engineering SQL Databases Software Technical Review Data Logging Retrieval-Augmented Generation Large Language Models Software Troubleshooting Indexer Information Technology Low Latency Machine Learning Operations Invoking Functions Software Version Control

Job description

  • ? Build production applications using large language models, smaller task-specific models, retrieval-augmented generation, tool/function calling, workflow orchestration, and deterministic business logic where appropriate.
  • ? Develop secure APIs, services, adapters, and event-driven integrations for digital channels, customer-care platforms, enterprise knowledge, billing and entitlement services, content/metadata systems, and internal workflows.
  • ? Implement authorization-aware tool use, input validation, idempotency, timeouts, retries, fallback behaviour, circuit breakers, and human escalation paths.
  • ? Choose prompts, retrieval, rules, conventional machine learning, or fine-tuning based on evidence rather than defaulting every problem to a large model.

Retrieval, data, and grounding:

  • ? Build ingestion, chunking, metadata, indexing, retrieval, reranking, citation, freshness, and deletion workflows for enterprise knowledge and approved content sources.
  • ? Preserve source permissions and customer/data boundaries throughout retrieval and generation; prevent unauthorized cross-user, cross-account, or cross-domain disclosure.
  • ? Partner with Data Engineering and domain owners on data quality, system-of-record alignment, lineage, and feedback loops. Evaluation and quality engineering
  • ? Create representative evaluation datasets and automated test suites for groundedness, relevance, correctness, task completion, refusal behaviour, safety, robustness, latency, and cost.
  • ? Run regression testing across prompt, model, retrieval, tool, and policy changes; analyse failure modes and improve the system using trace-based evidence.
  • ? Instrument online quality and business metrics, support controlled experiments, and incorporate human review for higher-risk or lower-confidence outcomes. Production operations and MLOps
  • ? Build CI/CD pipelines for code, configuration, prompts, evaluation assets, and model or index changes across separated development, test, and production environments.
  • ? Implement structured logging, tracing, token and infrastructure cost monitoring, model/provider health checks, alerting, dashboards, and operational runbooks.
  • ? Optimize throughput, latency, reliability, and cost using caching, batching, routing, prompt/context management, and appropriately sized models.
  • ? Participate in production support, incident response, root-cause analysis, and continuous improvement.

Security and responsible implementation:

  • ? Implement controls for prompt injection, jailbreak attempts, unsafe tool use, data leakage, malicious content, model abuse, and dependency/supply-chain risk.
  • ? Apply DIRECTV requirements for PII and payment-card data, identity and access, secrets management, retention, content rights, audit logging, and approved model/provider use.
  • ? Contribute reusable components to the AI control plane, including policy enforcement, prompt/model configuration, evaluation hooks, telemetry, and kill-switch or rollback mechanisms.
  • ? Work with Product Managers, UX, Solution Architects, AI Architects, Data Engineers, Cybersecurity, Quality Engineering, and Operations to deliver testable user outcomes.
  • ? Write maintainable code, automated tests, interface contracts, technical documentation, deployment guides, and operational runbooks; participate in code and design reviews.

Requirements

  • Typically, 10+ years in professional software engineering, including meaningful hands-on experience delivering AI, machine-learning, search, NLP, or data-intensive applications to production; equivalent experience is welcome.
  • Hands-on experience with LLM APIs, prompt and context design, RAG, embedding/search systems, structured outputs, tool/function calling, and automated evaluation.
  • Experience with SQL and document/search stores, containers, CI/CD, source control, cloud services, and observability practices.
  • Strong software engineering habits: modular design, automated testing, secure coding, peer review, performance troubleshooting, and production ownership.
  • Ability to explain model limitations and engineering trade-offs to technical and nontechnical partners.
  • Bachelor’s degree in computer science, engineering, data science, or a related field, or equivalent practical experience.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…