Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+24 more
Job description
The Senior Data Engineer owns the data platform end to end - designing, building, and maintaining the infrastructure, pipelines, and governed data layers that power analytics and downstream consumers across the organization. This is a hands-on engineering role centered on cloud data platform development, pipeline orchestration, and data modeling at scale.
The guiding principle is to build once, consume everywhere - define transformations and metrics a single time, governed and version-controlled in the warehouse, then serve them consistently to every downstream consumer: BI tools, client-facing reporting, and AI systems.
The ideal candidate is comfortable building data platforms and systems from scratch, thrive in a platform development and maintenance environment, and brings strong hands-on experience with Snowflake and workflow orchestration tools such as Apache Airflow and dbt (or equivalent platforms). This role does not own BI visualization - your work spans raw ingestion through the governed gold layer., Data Platform Development & Maintenance
- Design, build, and maintain scalable data pipelines and platform infrastructure on Snowflake.
- Architect and implement end-to-end data flows from source ingestion through the silver and gold layers.
- Own platform reliability, performance tuning, and ongoing maintenance - treating the data platform as a product.
- Build systems from the ground up where needed; evaluate existing systems and refactor for scale, cost efficiency, and maintainability.
- Establish engineering standards: version control, CI/CD, testing frameworks, and documentation for all platform components.
Pipeline Orchestration & Workflow Management
- Design and maintain orchestration workflows using Apache Airflow (or equivalent) to schedule, monitor, and manage data pipelines.
- Ensure pipeline reliability, observability, and failure recovery through alerting, logging, and automated retries.
- Coordinate dependencies across upstream sources and downstream consumers with well-defined SLAs.
Gold-Layer Modeling & Metrics
- Design, build, and maintain gold-layer data models and a governed metrics layer in Snowflake using dbt - clean, tested, documented, and version-controlled.
- Establish metric definitions as the single source of truth: calculated once, reused everywhere, with clear ownership and change management.
- Push transformation and calculation logic upstream into the warehouse so the consumption layer stays simple, consistent, and high-trust.
- Partner with analytics and BI stakeholders on the boundary between pipelines (data engineering) and consumption (analytics/reporting).
- Structure and document data models so they meet the governance and consistency requirements of AI agents and autonomous analytical systems.
AI-Native Development
- Build with coding agents and AI-assisted tooling as a primary part of the workflow - accelerating pipeline development, data modeling, documentation, and testing.
- Independently set up and manage development environments, repositories, and the tooling needed to work effectively with agentic systems.
- Help establish team practices and standards for building data infrastructure in the AI era.
Quality, Governance & Platform Judgment
- Champion data quality, consistency, and trust across all platform layers - ensuring data holds up under scrutiny from any downstream consumer.
- Contribute to platform architecture decisions; identify opportunities for automation, templating, and process improvement.
- Apply sound engineering judgment to evaluate build vs. buy decisions and tooling trade-offs., Leads the design, development, and operation of scalable data platforms and ETL/ELT pipelines using Python, PySpark, Databricks, Spark, Delta Lake, and cloud services. Responsibilities include data modeling, performance optimization, governance, lineage, quality validation, security, compliance, CI/CD, monitoring, AI/ML enablement, and data product delivery. Partners with stakeholders and mentors engineers while supporting reliable enterprise healthcare data solutions. Top Skills: Apache AirflowSparkAPIsAzureAzure Data FactoryCi/CdDatabricksDbtDelta LakeEltETLGitGoogle Cloud PlatformHipaaMicrosoft PurviewPysparkPythonSQLUnity Catalog Clear Street
Requirements
- 5+ years of hands-on experience in data engineering - building pipelines, data models, and platform infrastructure in a data-driven organization.
- Snowflake: Proven, hands-on production experience building data models and transformations in Snowflake. Deep familiarity with Snowflake architecture, performance optimization, and cost management.
- Workflow Orchestration (must have): Hands-on experience with Apache Airflow or an equivalent DAG-based orchestration platform (e.g., Prefect, Dagster, Mage). Ability to design, deploy, and operate complex pipeline workflows.
- dbt: Demonstrated experience using dbt for transformation modeling, testing, and documentation in a production warehouse environment. Equivalent semantic layer tooling experience considered.
- Strong SQL proficiency - able to write, optimize, and review complex queries across large datasets.
- Experience building data platforms or systems from scratch - not just extending existing infrastructure but designing and standing up new ones.
- Comfort with platform development and maintenance as a long-term ownership model - not just project delivery.
- Fluency working in the AI era: building with coding agents, setting up development environments, and using AI tooling as a core productivity multiplier.
- Familiarity with software engineering practices: version control (Git), CI/CD pipelines, automated testing, and code review.
- Strong communication skills - able to translate business requirements into technical data platform decisions.
Preferred
- Experience in pharmacy benefits management, healthcare technology, or a related regulated industry.
- Experience with cloud infrastructure and data platform tooling (AWS, Azure, or GCP) alongside the data stack.
- Familiarity with data governance frameworks, data contracts, or data mesh principles.
- Experience with streaming or near-real-time data pipelines (e.g., Kafka, Kinesis, Spark Streaming).
- Exposure to semantic/metrics layer tooling (e.g., MetricFlow, Cube, LookML).
- Experience building demo environments or client-facing data products.
Benefits & conditions
Owns the end-to-end data platform, including Snowflake infrastructure, ingestion pipelines, Airflow orchestration, dbt transformations, governed gold-layer models, and metric definitions. Ensures reliability, performance, testing, documentation, governance, and CI/CD standards. Builds data systems from scratch, partners with analytics stakeholders, and uses AI-assisted development tools to accelerate engineering work. Requires strong SQL, platform ownership, software engineering practices, and experience with Snowflake, Airflow, and dbt. The summary above was generated by AI, 150K-250K Annually Senior level 150K-250K Annually Senior level Fintech * Software * Financial Services Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements. Top Skills: AirflowArgo WorkflowsChange Data CaptureDatadogDbtFivetranKubernetesPythonReverse EtlSegmentSnowflakeSQL Block, 168K-297K Annually Senior level 168K-297K Annually Senior level Blockchain * eCommerce * Fintech * Payments * Software * Financial Services * Cryptocurrency Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation. Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
About the company
We are a healthcare technology company that provides platforms and solutions to improve the management and access of cost-effective pharmacy benefits. Our technology helps enterprise and partnership clients simplify their businesses and helps consumers save on prescriptions.
As a leader in SaaS technology for healthcare, we offer innovative solutions with integrated intelligence on a single enterprise platform that connects the pharmacy ecosystem. With our expertise and modern, modular platform, our partners use real-time data to transform their business performance and optimize their innovative models in the marketplace.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦