AI Engineer

FalconSmartIT
Los Angeles, CA, United States
3 days ago
Apply on jobs-us.falconsmartit.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Clean Code Principles Application Programming Interfaces (APIs) Artificial Intelligence Application Lifecycle Management Business Logic Audit Trail Automation of Tests Big Data Encodings Cyber Security Continuous Integration Data Validation
+23 more
Information Engineering Information Leak Prevention Decision Support Systems Key Management Machine Learning Metadata Modular Design Regression Testing Cloud Services Secure Coding Software Engineering SQL Databases Software Technical Review Data Logging Retrieval-Augmented Generation Large Language Models Software Troubleshooting Indexer Information Technology Low Latency Enterprise Integration Machine Learning Operations Software Version Control

Job description

AI Developer will build and operate AI-enabled applications for customer experiences, employee productivity, and operations. Use cases may include conversational support, knowledge assistance, search and discovery, summarization, classification, decision support, workflow automation, and content/metadata operations.

This is a production engineering role. Success requires strong software fundamentals, disciplined evaluation, secure enterprise integration, and ownership of quality, latency, cost, observability, and supportability throughout the application lifecycle.

Key responsibilities

AI application engineering:

  • Build production applications using large language models, smaller task-specific models, retrieval-augmented generation, tool/function calling, workflow orchestration, and deterministic business logic where appropriate.

  • Develop secure APIs, services, adapters, and event-driven integrations for digital channels, customer-care platforms, enterprise knowledge, billing and entitlement services, content/metadata systems, and internal workflows.

  • Implement authorization-aware tool use, input validation, idempotency, timeouts, retries, fallback behaviour, circuit breakers, and human escalation paths.

  • Choose prompts, retrieval, rules, conventional machine learning, or fine-tuning based on evidence rather than defaulting every problem to a large model.

Retrieval, data, and grounding:

  • Build ingestion, chunking, metadata, indexing, retrieval, reranking, citation, freshness, and deletion workflows for enterprise knowledge and approved content sources.

  • Preserve source permissions and customer/data boundaries throughout retrieval and generation; prevent unauthorized cross-user, cross-account, or cross-domain disclosure.

  • Partner with Data Engineering and domain owners on data quality, system-of-record alignment, lineage, and feedback loops. Evaluation and quality engineering

  • Create representative evaluation datasets and automated test suites for groundedness, relevance, correctness, task completion, refusal behaviour, safety, robustness, latency, and cost.

  • Run regression testing across prompt, model, retrieval, tool, and policy changes; analyse failure modes and improve the system using trace-based evidence.

  • Instrument online quality and business metrics, support controlled experiments, and incorporate human review for higher-risk or lower-confidence outcomes. Production operations and MLOps

  • Build CI/CD pipelines for code, configuration, prompts, evaluation assets, and model or index changes across separated development, test, and production environments.

  • Implement structured logging, tracing, token and infrastructure cost monitoring, model/provider health checks, alerting, dashboards, and operational runbooks.

  • Optimize throughput, latency, reliability, and cost using caching, batching, routing, prompt/context management, and appropriately sized models.

  • Participate in production support, incident response, root-cause analysis, and continuous improvement.

Security and responsible implementation:

  • Implement controls for prompt injection, jailbreak attempts, unsafe tool use, data leakage, malicious content, model abuse, and dependency/supply-chain risk.

  • Apply DIRECTV requirements for PII and payment-card data, identity and access, secrets management, retention, content rights, audit logging, and approved model/provider use.

  • Contribute reusable components to the AI control plane, including policy enforcement, prompt/model configuration, evaluation hooks, telemetry, and kill-switch or rollback mechanisms.

Team delivery:

  • Work with Product Managers, UX, Solution Architects, AI Architects, Data Engineers, Cybersecurity, Quality Engineering, and Operations to deliver testable user outcomes.

  • Write maintainable code, automated tests, interface contracts, technical documentation, deployment guides, and operational runbooks; participate in code and design reviews.

Requirements

  • Typically, 10+ years in professional software engineering, including meaningful hands-on experience delivering AI, machine-learning, search, NLP, or data-intensive applications to production; equivalent experience is welcome.
  • Hands-on experience with LLM APIs, prompt and context design, RAG, embedding/search systems, structured outputs, tool/function calling, and automated evaluation.
  • Experience with SQL and document/search stores, containers, CI/CD, source control, cloud services, and observability practices.
  • Strong software engineering habits: modular design, automated testing, secure coding, peer review, performance troubleshooting, and production ownership.
  • Ability to explain model limitations and engineering trade-offs to technical and nontechnical partners.
  • Bachelor’s degree in computer science, engineering, data science, or a related field, or equivalent practical experience.

About the company

About FalconSmartIT

We are a specialist IT Recruitment Agency. We specialise in finding the best IT professionals for your given IT requirement.

Falcon Smart LLC (US), Falcon Smart IT (UK), FS Talent Acquisition (India) set a mission to deliver value, service, transparency and quality service to all.

Headquartered in London,UK

We are Specialists at providing contract and permanent IT, Marketing, HR and Accountancy recruitment across the Globe, working with businesses of all sizes, from Small to Medium Enterprises (SMEs) to large international corporations.

Our industry and sector knowledge is second to none and whilst we utilise all of the key IT specific and leading generic job boards, nothing compares to our own carefully grown database and working knowledge of “whose who” in key industry sectors.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs-us.falconsmartit.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:35 min

Learning resources and community engagement for AI engineers

Alfonso Graziano Alfonso Graziano · Coffee With Developers

2:36 min

Analyzing limitations with PostgreSQL bitmap heap scans

Dharin Shah Dharin Shah · World Congress 2025

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · World Congress 2022

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

7:10 min

Exploring pathways into the machine learning engineering field

Jose Luis Latorre Millas · LIVE

1:32 min

Generating functional runtime database columns using indexer properties

Halil İbrahim Kalkan Halil İbrahim Kalkan · World Congress 2026 Europe

Videos

See all

Related articles

See all