Data Engineer

ConsenSys Inc.
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 187K

Job location

Remote

Tech stack

Airflow
Amazon Web Services (AWS)
Big Data
Google BigQuery
Cloud Database
Continuous Integration
Data Governance
Data Integration
ETL
Database Queries
Distributed Computing Environment
Document-Oriented Databases
Github
Python
Meta-Data Management
SQL Databases
Workflow Management Systems
Pulumi
Scripting (Bash/Python/Go/Ruby)
Snowflake
Spark
Free and Open-Source Software
Web3.js
Terraform
Data Pipelines
Amazon Web Services (AWS)
Redshift

Job description

The Data team sits within the Office of the COO and builds the infrastructure that powers analysis across the organisation. We design, run, and optimise pipelines that bring together product, marketing, and financial data at scale. Our role is to ensure data is reliable, accessible, and ready for use-helping Consensys move fast while maintaining quality and trust.

What you'll do

  • Design, build, and maintain robust data pipelines that integrate sources across the business.
  • Collaborate closely with analysts, business stakeholders, and other engineering teams to gather requirements, align timelines, discuss architecture, and ensure successful delivery.
  • Document data pipelines, best practices, and processes to support onboarding and knowledge sharing within the team.
  • Develop and optimize data models to deliver trusted, structured, and business-ready data.
  • Ensure data quality, security, and governance are embedded in all pipelines and systems.
  • Orchestrate and monitor pipeline execution to ensure reliability and scalability.
  • Deploy and manage infrastructure as code.
  • Build and tune big data pipelines using SQL, Python, and distributed processing frameworks.
  • Work with cloud data warehouses to enable insights and analytics.
  • Maintain and update reporting solutions and user dashboards.
  • Automate workflows and improve CI/CD pipelines to reduce manual processes., In the rapidly evolving Web3 space, we believe that everyone is a builder. This expansive paradigm requires a range of backgrounds, talents, skills, and experiences to influence and shape the future. At Consensys, this diversity fuels our ability to shift control and redefine the realm of possibility. We are committed to ensuring that our technology empowers people and communities with economic and political agency through decentralized technologies. We welcome the range of perspectives and differences and celebrate them. We're excited to see how your unique skills as a builder can contribute to our vision, drive innovation, and help us shape a more inclusive Web3.

Requirements

  • Over 6 years of experience as a Data Engineer
  • Use Trusted Execution Environments (TEEs) to securely process sensitive user data, ensuring it remains protected and only aggregated insights are released.
  • Strong SQL skills and experience with cloud warehouses (e.g.: Snowflake, BigQuery, Redshift).
  • Hands-on experience with transformation and orchestration tools (e.g.: dbt, Airflow, Dagster).
  • Comfort with Python or other scripting languages for ETL and automation.
  • Familiarity with data governance and metadata management (e.g.: DataHub).
  • Experience deploying and managing infrastructure as code (e.g.: Terraform, Pulumi).
  • Exposure to data integration and ingestion tools (e.g.: Airbyte, Segment).
  • Experience with big data and distributed processing (e.g.: Apache Spark, AWS EMR, S3).
  • Exposure to open source projects
  • Experience maintaining and improving reporting solutions and dashboards (e.g.: Preset/Superset, Cube.dev).
  • Familiarity with CI/CD practices and automation (e.g.: GitHub Actions).
  • A collaborative mindset and eagerness to work with both technical and non-technical colleagues.

Don't meet all the requirements? Don't sweat it. We're passionate about building a diverse team of humans and as such, if you think you've got what it takes for our chaotic-but-fun, remote-friendly, start-up environment-apply anyway, detailing your relevant transferable skills in your cover letter. While we have a pretty good idea of what we need, we're ready for you to challenge our thinking on who needs to be in this role.

About the company

Consensys is the leading blockchain and web3 software company founded by Joe Lubin, CEO of Consensys and Co-Founder of Ethereum. Since 2014, Consensys has been at the forefront of innovation, pioneering technological developments within the web3 ecosystem. Through our product suite, including the MetaMask platform, Infura, Linea, Diligence, and our NFT toolkit Phosphor, we have become the trusted collaborator for users, creators, and developers on their path to build and belong in the world they want to see. Whether building a dapp, an NFT collection, a portfolio, or a better future, the instinct to build is universal. Consensys inspires and champions the builder instinct in everyone by making web3 universally easy to use and develop on. Our mission is to unlock the collaborative power of communities by making the decentralized web universally easy to access, use, and build on. You'll get to work on the tools, infrastructure, and apps that scale these platforms to onboard one billion participants and 5 million developers. You'll be constantly exposed to new concepts, ideas, and frameworks from your peers, and as you work on different projects - challenging you to stay at the top of your game. You'll join a network of builders that reaches the edge of our ecosystem. Consensys alumni have moved on to become tech entrepreneurs, CEOs, and team leads at tech companies.

Apply for this position