Data Engineer

• Ingesting raw infrastructure and monitoring data from tools such as:
• DC Track, NetBox, Shipyard, Kentik, ThousandEyes, Electric Eel
• PagerDuty, Sentry, internal alerting systems
• Modeling and transforming that data within Snowflake to support consistent analytics
• Building data models and views to support:
• GPU and CPU capacity snapshots (hourly, daily, weekly)
• Real-time and historical Top-K alert and response visibility
• Signal-to-noise metrics, SLA tracking, and incident traceability
• Enabling visualization through Looker and Grafana for different stakeholder audiences
• Supporting “What-If” modeling scenarios for forecasting infrastructure runway

What We’ll Expect From You:

• Build scalable data pipelines to collect and transform structured and unstructured operational data
• Define Snowflake schemas and transformation logic to support current and future reporting use cases
• Collaborate with engineering, SRE, Capacity, and operations teams to align on source systems and field mappings
• Support interim manual data ingestion efforts while longer-term automation is developed
• Proactively identify data quality issues and improve reliability of dashboard inputs
• Move fast, iterate weekly, and help validate early dashboard concepts into production-grade systems

• Strong experience with Snowflake (or similar cloud data warehouse platforms)
• Proficient in SQL and data modeling best practices
• Experience building data pipelines using Python, dbt, or similar tools
• Familiarity with Looker, Grafana, or other BI tools for dashboarding
• Experience working with infrastructure, alerting, or monitoring systems is a strong plus
• Ability to work in an iterative, fast-paced environment with minimal oversight
• Strong communication and collaboration skills, particularly with distributed teams, Automation, Best Practices, Business Intelligence Software, CPU (Central Processing Unit), Cloud Computing, Communication Skills, Data Collection, Data Management, Data Modeling, Data Quality, Data Warehousing, Forecasting, GPU (Graphics Processing Unit), Identify Issues, Looker, Metrics, Production Systems, Python Programming/Scripting Language, Reliability Engineering, Reporting Dashboards, SQL (Structured Query Language), Scalable System Development, Service Level Agreement (SLA), Snowflake Schema, Support Documentation, Team Player, Traceability, Unstructured Data, Use Cases