Lead Data Engineer

Akiba Trading Corp.
New York, NY, United States
3 days ago
Apply on www.builtincolorado.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$89,000.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Amazon S3 Data Analysis Software as a Service Cloud Computing Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Structures Data Stores Data Systems
+18 more
Data Warehousing Python (Programming Language) PostgreSQL Machine Learning Scala (Programming Language) SQL Databases Systems Integration Enterprise Data Management Azure Data Factory Snowflake Apache Spark Electronic Medical Records Pandas Information Technology Looker Analytics Data Pipelines Docker Amazon Redshift

Job description

Leads a data engineering team and supervises one Data Engineer while designing, maintaining, and optimizing reliable data pipelines and infrastructure. The role integrates internal and external data sources, supports SaaS analytics dashboards and connected platforms, improves data-store performance, and ensures infrastructure quality, security, and uptime. Requires proficiency in Python, databases, distributed processing, orchestration, AWS, and machine learning., This position reports to the Director of Engineering, DevOps & Data Engineering and is responsible for the design, reliability, and performance of Adelaide’s data pipelines and data infrastructure. The role supervises one Data Engineer.

In this role, you’ll work with a team of data engineers and data scientists to structure and maintain the network of data that flows from internal and external sources into our SaaS analytics dashboard and connected platforms.

This role is based in New York, NY, with flexible work options.

Base salary: $88,525/yr

What you’ll learn

An important part of our culture is continuous learning and the open sharing of ideas. We offer:

  • Access to a broad network of investors and advisors who can help you and your team succeed
  • Mentorship from executives with decades of experience in adtech and media
  • Regular internal knowledge-sharing sessions
  • An education budget to support ongoing professional growth and development

Core responsibilities

  • Structure a sophisticated network and pipeline of data across internal and external sources
  • Maintain a high degree of uptime for our SaaS analytics dashboard and connected platforms
  • Work with other team members to design, build, deploy, and maintain reliable data pipelines
  • Maintain and optimize existing data pipelines and integrations
  • Optimize our data stores for fast, efficient querying to support technology and reporting needs
  • Ensure the quality, reliability, and security of our data infrastructure, Own Fullbay’s Snowflake data platform end to end, including dimensional modeling, certified metric definitions, semantic layers, identity resolution, transformations, governance, security, cost management, source ingestion, and AI-agent enablement. Build tested SQL and transformation code, establish company-wide data standards, document systems thoroughly, and direct an architecture consultant. Provide guidance for self-service data use while serving as the final authority on definitions, access, and platform design. Top Skills: Change Data CaptureContinuous IntegrationSalesforceSnowflakeSQL Nexcess

Lead Data Engineer

8 Days Ago Remote United States Senior level Senior level Software Leads and mentors the Data Engineering team while remaining hands-on in designing, building, and maintaining scalable data pipelines, warehouses, integrations, and infrastructure. Establishes architecture, reliability, quality, and performance standards; guides technical delivery; and resolves complex issues. Partners with Finance and business stakeholders to translate data needs into practical solutions, sets technical direction, evaluates technologies, and communicates strategy, risks, and recommendations to leadership. Top Skills: AirflowAWSAzureCi/CdCloud Data PlatformsData PipelinesData WarehousesDbtEltETLGoogle Cloud PlatformInfrastructure As CodeJavaKafkaPythonScalaSparkSQL Magna Legal Services

Requirements

  • Bachelor’s degree in Computer Science
  • Proficiency in Python, Redshift, Postgres, SQL, Spark, Scala, and Airflow
  • Experience with the Pandas library and Docker
  • Familiarity with AWS technologies such as ECS, S3, Kinesis, Redshift, and EMR
  • Strong understanding of data structures and algorithms
  • Experience with machine learning
  • Passion for delivering high-quality, reliable data solutions

What will set you apart - OPTIONAL

  • Experience in ad tech, measurement, or verification
  • Experience with high-throughput or near-real-time data pipelines
  • Experience with Snowflake or Looker

Benefits & conditions

Health & Wellness

  • Medical, dental, and vision insurance
  • Paid time off
  • Parental leave
  • Employee development & wellness stipend
  • Holiday break
  • Volunteer time off

Financial & Compensation

  • Competitive salary
  • Performance-based quarterly bonus
  • Stock options
  • 401(k) retirement plan

Workplace & Equipment

  • Remote-first environment
  • New York office access
  • Access to available WeWork spaces, 155K-175K Annually Senior level 155K-175K Annually Senior level Information Technology * Legal Tech * Consulting Lead the architecture, development, and optimization of Snowflake and enterprise data platforms. Design scalable ETL/ELT pipelines, dimensional data models, and medallion architectures while establishing engineering standards for testing, deployment, monitoring, security, and data quality. Partner with stakeholders on technical roadmaps, mentor engineers and analysts, conduct design and code reviews, modernize legacy pipelines, and deliver reliable, reusable data solutions. Top Skills: Azure Data FactoryDbtDimensional Data ModelingEltETLMedallion ArchitecturePythonSigmaSnowflakeSQLStar Schema

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

About the company

Adelaide is the leader in one of the fastest-growing areas of advertising: attention measurement and activation.

Since 2020, we’ve become the trusted media quality measurement partner for 40% of Fortune 50 brands who rely on our award-winning AU metric to plan smarter campaigns, invest in high-quality inventory, and dive stronger business outcomes. Adweek has called Adelaide’s AU “the attention economy’s most widely recognized metric,” and AdExchanger named it “Best measurement/Analytics Capability.”

Our business continues to scale rapidly, outperforming the industry with a 35% three-year CAGR. What began as a 9-person startup in 2019 is now a team of more than 75.

The past year brought meaningful expansion. We launched the AU ecosystem, giving brands, media agencies, and publishers a unified way to leverage and transact on AU. We broadened our programmatic footprint with custom bidding in GoogleDV360 and pre-bid targeting in The Trade Desk, and grew our partner roster to over 125 platforms and publishers. Leading brands like Dell, Diageo, an Jaguar Land Rover-along with premium publishers such as Hearst, Spotify, and The New York Times-continue to demonstrate AU’s value across the media lifecycle.

Adelaide is backed by prominent investors such as Human Ventures (Joe Marchese), Aperiam Ventures (Joe Zawadzki & Eric Franchi), WGI (Jonah Goodhart), and Irwin Gotlieb.

We have a NYC office and a London WeWork, but operates as a remote-friendly company with flexible work options. How we work

We’re a team of action-oriented doers-management rolls up their sleeves and contributes every day. Our culture is rooted in curiosity and rigor: opinions are held lightly, debated openly, and strengthened through testing. Everyone is encouraged to play a role in shaping planning and strategy.

We’re built on belonging and growth-94% of employees report a strong sense of belonging, and 87% say they’re happy at work.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.builtincolorado.com
Prepare application

Good distractions

Loading talks and stories from around this role…