Data Engineer

Remote Hiring Remotely in United States Mid level Remote Hiring Remotely in United States Mid level Build and maintain production ETL pipelines for structured and unstructured data, integrate machine learning models for enrichment, develop data transformations and quality monitoring, design warehouses and dimensional models, establish governance frameworks, and contribute to data architecture and platform improvements. Collaborate with data scientists, analysts, and engineering teams to deliver reliable, actionable intelligence. The summary above was generated by AI, Base Operations is building the world’s largest dataset of global threat patterns and street-level intelligence. We are looking for an exceptional data engineer that can define, build, and mature the data pipelines, models, and warehouse to help us excel in this objective. This individual should have the technical acumen to contribute thought leadership relative to our architecture strategy, while also excelling at mapping that strategy into a tactical plan and executing against it. RESPONSIBILITIES

You will:

• Build, test, and maintain robust ETL pipelines for structured and unstructured data sources, including integration with ML models for data enrichment, with focus on production stability, performance optimization, and incident resolution
• Develop data transformation, validation, and quality monitoring processes to ensure reliable and actionable data
• Design and implement data warehouse solutions and data models to support analytics and reporting needs
• Establish data quality frameworks with monitoring, alerting, and remediation processes
• Contribute to overall data architecture decisions and lead implementation of data platform improvements, Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance. Top Skills: Ai TechnologiesApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform Optum

Data Engineer

8 Days Ago In-Office or Remote 120K-215K Annually Senior level 120K-215K Annually Senior level Artificial Intelligence * Big Data * Healthtech * Information Technology * Machine Learning * Software * Analytics Build and lead production AI/ML, Generative AI, and data engineering solutions for healthcare analytics and patient safety platforms. Develop full-stack applications, microservices, APIs, data pipelines, dashboards, self-service analytics, RAG systems, and event-driven architectures using cloud-native technologies. Apply engineering best practices including testing, CI/CD, observability, security, and performance optimization. Mentor engineers, lead technical initiatives, and collaborate with product, analytics, business, and platform teams. Top Skills: Amazon KinesisAWSAzureAzure Event HubsCi/CdDatabricksDelta LakeGCPGenerative AiJavaJavaScriptKafkaLarge Language Models (Llms)Microsoft FabricMlopsPysparkPythonReactRest ApisRetrieval-Augmented Generation (Rag)SnowflakeSparkSpring BootSQLTypescriptVector Search, Gradient AI, Build and maintain automated data quality testing for customer data pipelines. Responsibilities include developing dbt, Soda, and SQL checks; validating schemas, loads, sequencing, and downstream reconciliations; detecting anomalies; managing severity levels and customer overrides; reporting quality metrics; and partnering with engineering teams to embed testing into new pipelines. The role requires strong backend testing, SQL, Python, Airflow, and Databricks experience, along with excellent debugging and communication skills. Top Skills: Apache AirflowCi/CdCypressDatabricksDbtDelta LakeGitPlaywrightPythonSodaSpark SqlSQL

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

• Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
• Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
• Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
• Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
• Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
• Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

• 3+ years experience building production data pipelines and working with modern data stack tools
• 3+ years implementing and maintaining data warehouses and dimensional data models
• Strong SQL skills and experience with data modeling best practices
• Proficiency in Python for data engineering tasks
• Experience with workflow orchestration and automation tools
• Experience implementing data quality and governance practices
• Strong collaboration skills working with data scientists, analysts, and engineering teams

Preferred Experience

• Experience working with geospatial data
• Working with large-scale datasets
• Experience with web scraping
• Understanding of ML and AI based infrastructure
• Familiarity with JavaScript

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.

Base Operations decodes the world’s threat landscape into actionable security insights that enable organizations to protect their people, assets, and operations. We empower security teams to better assess threats, manage risk across large footprints, and make data-driven decisions using granular, street-level intelligence.

As a category-creator in a growing market, we are looking for impact-driven individuals who are passionate about technology and are committed to helping our customers operate with efficiency and greater accuracy. We developed our technology at Harvard and MIT and use cutting-edge AI. The company is award-winning and backed by top-tier VCs. Our customers include some of the most sophisticated and relevant companies in the Fortune 500. Our team cares about solving hard problems, promoting transparency, encouraging growth in emerging markets, and empowering people to safely explore the world. We are a thoughtful, dedicated, and fun-loving group obsessed with disrupting the security intelligence industry and winning the loyalty of our customers.