Platform Engineer

• Design realistic, multi-step Grafana workflows, including dashboards, alerting rules, and data source configuration.
• Perform each workflow on a hosted Grafana instance to produce a reference trajectory.
• Write clear, specific task prompts with measurable outcomes for programmatic verification.
• Implement programmatic graders to check task completion accuracy.
• Review AI agent attempts, identify failures, and tag root causes.
• Calibrate task difficulty to ensure challenges are solvable, iterating on prompts based on model performance., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Must-Have

• 2+ years of daily, professional Grafana experience.
• Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration.
• Ability to articulate workflows for programmatic verification.
• Comfort writing basic grading scripts in Python.

Preferred

• Experience with Grafana API automation.
• Kubernetes/infrastructure monitoring background.
• Familiarity with AI evaluation or benchmarking.

• $185,000-250,000 per year Join a high-growth profitable AI startup transforming a deeply broken system with agentic driven software, building products that directly impact the lives and careers of top globa…

• 16 days ago

© 2026 Careerjet All rights reserved