Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
Our client is seeking a Data Engineer for a direct hire opportunity. The Data Engineer will help scale the data foundations that power the business. This individual will design, build, and optimize the data pipelines and infrastructure that enable data to be a strategic asset across the organization. This role is highly collaborative and will partner with the Product, Engineering, Analytics teams and business stakeholders to quickly understand evolving challenges and deliver scalable, maintainable, and high quality solutions.
Data sits at the core of client operations. The firm relies on clean, reliable, well structured data to drive decision making, enhance client experiences, and support a rapidly growing product suite. This individual will be responsible for moving and transforming data and developing a deep understanding of the business context behind it and help teams act on insights., * Develop and automate large scale, high-performance data platform pipelines and infrastructure to drive business growth and enable data-driven decision making.
- Design and develop reusable components and frameworks for ingestion, cleansing, and data quality.
- Streamline the ingestion of raw data from various sources into our Data Lake and Data Warehouse.
- Design data models for optimal storage and retrieval that represent the tangible business domains across ecosystem.
- Coordinate closely with the Operations, Sales, and Product Development teams daily to push FinTech strategy and improve the overall profitability of the business.
Requirements
- 6+ years of professional experience in a data engineering or data-driven software engineering role
- Exceptional Python and SQL skills
- Extensive experience with orchestration frameworks (Prefect, Airflow, Dagster, etc.)
- Deep understanding of OLAP (Snowflake, Databricks) and OLTP (PostgreSQL, MongoDB) databases and ELT frameworks (dbt, dlthub)
- Experience developing and deploying code to Cloud environments (AWS, GCP, Azure)
- Possess a strong grasp of object-oriented and functional programming and an ability to write easy-to-scale, high-quality code
- Experience leveraging stream processing frameworks (Kafka, Flink, Spark)
- Knowledge of infrastructure-as-code frameworks (terraform or cloud formation)
- Detail-oriented and able to multitask and work in a fast-paced environment
- Able to work independently while also being a strong team player
- Excellent written and verbal communication
- Passionate about learning and mastering cutting-edge technologies
- Professional experience with JVM based languages such as Scala, Java, and Kotlin is preferred
- Knowledge of financial markets and financial instruments is preferred
About the company
By using best practices and optimal employee recruiting strategies, Kavaliro provides employers with employment solutions by providing the most qualified and professional employees, who can staff both project and permanent positions in order to ensure the ongoing success of all types of businesses. We use a streamlined-yet-thorough approach to staffing that saves our clients administrative time, resources and money.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story