Principal, AI Platform Engineer
Role details
Job location
Tech stack
Job description
We are seeking a Principal AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. This role will create the evaluation, observability, safety, and launch-readiness infrastructure needed to ship AI features with measurable quality, reliability, and customer impact. In this role, you will be responsible to:
- Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems.
- Own golden datasets, regression suites, offline and online evals, and LLM-as-judge governance.
- Develop observability for model quality, latency, cost, drift, safety, and customer impact.
- Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
- Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
- Define reusable standards for AI quality, monitoring, safety, and operational readiness., Vivint enforces a safety culture whereby all employees have the responsibility for continuously developing and maintaining a safe working environment. Each new employee is responsible for completing all training requirements. Additionally, the employee must accept they have responsibility for maintaining the safety of themselves, their co-workers, and the public. Employee must adhere to all written and verbal instructions, promptly report and correct all hazards or unsafe conditions, question non-standard operations or unmitigated hazards, and provide feedback to management on all safety issues.
We support the use of AI tools to help you prepare for your interview (e.g., practicing responses, researching the role, or refining your resume). However, during interviews and assessments, we expect responses to reflect your own thinking, experience, and communication. Use of AI to generate or read answers in real time, complete assessments, or misrepresent your qualifications is not permitted and may impact your candidacy.
NRG Energy is committed to a drug and alcohol-free workplace. To the extent permitted by law and any applicable collective bargaining agreement, employees are subject to periodic random drug testing, and post-accident and reasonable suspicion drug and alcohol testing. EOE AA M/F/Vet/Disability. Level, Title and/or Salary may be adjusted based on the applicant's experience or skills.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Data Science, or related field
- 10+ years of software engineering, ML engineering, or AI platform experience
- Experience evaluating, deploying, or monitoring production AI systems
- Strong Python and data engineering skills
- Experience with offline/online evaluation, data quality, model monitoring, or observability systems
- Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails
- Strong communication skills and ability to set standards across teams, * Experience with LLM-as-judge, agent tracing, multimodal evals, golden datasets, or automated regression suites
- Experience with GCP/AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry, Private Cloud or similar tooling
- Experience with privacy-aware AI systems, customer trust metrics, or launch-readiness processes
- Experience supporting computer vision, GenAI, recommendation, or edge AI products
- Experience building developer platforms or internal AI tooling
Benefits & conditions
Learn about the Vivint Culture and why it's a great place to grow your career!
Here are some highlighted perks you should ask us about:
- Free daily lunch and drinks on site
- Paid holidays and flexible paid time away
- Employee/Friends/Family Discounts
- Onsite health clinic, gym, gaming tables
- Medical/dental/vision/life coverage & 24/7 Medical Hotline
- 401(k) + Employer Match
- Employee Resource Groups
- Quarterly Innovation Weeks