Data Operations Engineer II

Experteer Overview In this role, you build and maintain data ingestion systems that move, store, and transform data across platforms, ensuring reliability and data integrity. You'll work across Databricks, the Data Marketplace, and the Ad Platform, developing automation to monitor pipelines and detect issues. You'll own and optimize end-to-end data pipelines, collaborate with cross-functional teams, and drive proactive maintenance and improvement initiatives. This is a hands-on, detail-oriented position with a focus on operational excellence at scale. Compensation / Benefits * Build, monitor, and maintain data ingestion processes and systems across platforms, including Databricks, Data Marketplace, and Ad Platform * Develop and optimize scripts (Python, PowerShell, Bash) for data collection and monitoring * Own the operational state of data pipelines: monitoring, incident response, maintenance, escalation * Maintain SQL databases for data loading and deployment (Forecast, current, historical, locations) * Develop and maintain unit test coverage for Data Ops codebases * Administer GoAnywhere and other managed file transfer platforms * Build end-to-end monitoring and automated alerting for pipeline health * Diagnose incidents, identify root causes, implement fixes, validate recovery, document resolutions * Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps) * Conduct proactive maintenance, patching, and checks to prevent incidents * Document scripts, automation, monitoring workflows, data pipelines, and deployment procedures * Contribute to runbooks and improve incident-based documentation * Collaborate with cross-functional teams and support scripting needs * Plan and prioritize work independently to meet deadlines * Share knowledge and mentor peers * Perform other duties as assigned Tasks * BA/BS in Computer Science, Information Technology, or related field * 3+ years in data operations, scripting, and automation * Intermediate scripting proficiency (Python, PowerShell, Bash) * Proficiency with Azure, Databricks, Snowflake, and SQL Server * Experience managing relational databases (SQL) Key requirements *

Platform locations) * Develop and maintain unit test coverage for Data Ops codebases * Administer GoAnywhere and other managed file transfer platforms * Build end-to-end monitoring and automated alerting for pipeline health * Diagnose incidents, identify root causes, implement fixes, validate recovery, document resolutions * Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps) * Conduct proactive maintenance, patching, and checks to prevent incidents * Document scripts, automation, monitoring workflows, data pipelines, and deployment procedures * Contribute to runbooks and improve incident-based documentation * Collaborate with cross-functional teams and support scripting needs * Plan and prioritize work independently to meet deadlines * Share knowledge and mentor peers * Perform other duties as assigned Tasks * BA/BS in Computer Science, Information Technology, or related field * 3+ years in data operations, scripting, and automation * Intermediate scripting proficiency (Python, PowerShell, Bash) * Proficiency with Azure, Databricks, Snowflake, and SQL Server * Experience managing relational databases (SQL) Key requirements *