> Markdown version of [/jobs/ext/2590491-manager-data-engineer-remote-organization](https://www.wearedevelopers.com/jobs/ext/2590491-manager-data-engineer-remote-organization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Manager, Data Engineer (Remote) Organization - **Company:** ARCH CAPITAL HOLDINGS, LLC - **Location:** New York, NY, United States (Remote available) - **Experience:** Experienced - **Salary:** $100,500.0 - $174,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Data Analysis, Automation of Tests, Microsoft Azure, Big Data, Cloud Computing, Configuration Management, Code Review, Computer Programming, Continuous Delivery, Continuous Integration, Information Engineering, Data Files, Data Structures, Data Systems, Data Warehousing, Database Design, Distributed Computing Environment, Systems Analysis, Python (Programming Language), Performance Tuning, Systems Development Life Cycle, Software Engineering, SQL Databases, Data Processing, Scripting, Cloud Platform System, Data Ingestion, Snowflake, Apache Spark, Pyspark, Information Technology, Data Analytics, Star Schema, Data Management, Machine Learning Operations, Software Version Control, Data Pipelines, Databricks - **Published:** August 20, 2026 - **Apply:** https://www.careerbuilder.com/job-details/manager-data-engineer-remote-new-york-ny--27be9305-a33e-430f-b9de-8ca85f33f416 ## About the Role Data Engineering * Strong programming expertise in Python and SQL, including data engineering frameworks, large-scale data manipulation, and governed AI-assisted development practices * Apache Spark proficiency (PySpark preferred) and experience with distributed data processing, including building scalable pipelines and optimizing performance for large-scale datasets * Cloud data platform proficiency (Snowflake, Databricks, Azure ecosystem fundamentals) * Data warehousing and modeling fundamentals (schema design, conformed definitions, performance optimization) * Data quality and observability practices (testing, reconciliation, monitoring) Analytics & AI Readiness * Insurance data modeling for analytics and actuarial-ready data structures * MLOps familiarity supporting operationalized analytics and models * Semantic modeling skills (business definitions, metrics, ontology/taxonomy/domain models) * Business definition standardization for reuse across BI and AI use cases Leadership & Operating Model * Self-directed execution and ownership in a distributed environment, combined with strong cross-functional collaboration, stakeholder partnership, and team building * Strong problem-solving and critical thinking skills, including the ability to decompose complex challenges * Clear communication across technical and business audiences, with the ability to adapt effectively in ambiguous and evolving environments, * 6+ years' experience of hands-on development in Python and distributed processing environments (e.g., Spark) * 2-3+ years of technical leadership or project delivery ownership experience * Hands-on Databricks experience highly preferred Education * College degree in Computer Science, Engineering, Statistics, Mathematics, Actuarial Science, Data Analytics, or equivalent. For individuals assigned or hired to work in the location(s) indicated below, the base salary range is provided. Range is as of the time of posting. Position is incentive eligible., Actuarial Skills, Analysis Skills, Apache Spark, Architectural Services, Artificial Intelligence (AI), Business Intelligence, Business Processes, Cloud Computing, Coaching, Code Reviews, Communication Skills, Computer Programming, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Analysis, Data Management, Data Modeling, Data Processing, Data Quality, Data Sets, Data Structures, Data Warehousing, Database Design, Dental Insurance, Ecosystems, Embedded Systems, Health Plan, Insurance, Knowledge Base, Leadership, Mathematics, Microsoft Windows Azure, Performance Tuning/Optimization, Predictive Modeling, Prescription Drugs, Problem Solving Skills, Productivity Management, Project Lifecycle, Python Programming/Scripting Language, Reconciliation, SQL (Structured Query Language), Scalable System Development, Snowflake Schema, Software Engineering, Source Code/Configuration Management (SCM), Standards Development, Statistics, Strategic Analysis, Systems Analysis, Team Building, Technical Leadership, Technical Support, Test Automation, Use Cases ## Description As Manager of Strategic Analytics Services, supporting the Claims Analytics group, you will lead end-to-end delivery of complex data pipelines that put analytics at the center of business processes. This is a hands-on role that combines execution, technical leadership, and stakeholder partnership, including leading and developing a team of data engineers. You will work closely with business and technical leaders to align priorities, shape scalable data solutions, and deliver measurable outcomes. You will also guide engineers and reinforce strong delivery practices, while advancing the team's capabilities in modern data engineering, AI-assisted development, and well-governed, reusable data systems. Responsibilities * Lead delivery of high-quality data solutions by partnering with stakeholders and coaching data engineers. * Own end-to-end data engineering delivery across the project lifecycle. * Build strong partnerships across the organization to align priorities and deliver data-related goals. * Design clear, analytics-ready data structures by anticipating downstream analytical needs. * Evaluate and adopt new technologies and data sources to improve capability and efficiency. * Automate data ingestion and integration to reliably connect internal and external data sources. * Document data sources, definitions, and technical solutions to support transparency and reuse. * Reinforce strong delivery hygiene (version control, code review, automated testing, CI/CD, and operational readiness/monitoring). * Apply agentic, AI-assisted coding practices to accelerate delivery while maintaining appropriate controls. * Build agent-ready data assets, including semantic layer components (ontology, taxonomy, domain models) and governed access. * Provide retrieval-ready context (RAG pipelines, vector stores, knowledge bases) when needed. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)