Senior Data Engineer
Legend
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 61KJob location
Tech stack
API
Airflow
Amazon Web Services (AWS)
Continuous Integration
Data Governance
Data Infrastructure
Data Security
Data Systems
Data Visualization
Github
Python
Transaction Data
Snowflake
FastAPI
Kafka
Terraform
Data Pipelines
Job description
- Design, manage, and improve the data infrastructure required by the teams that consume data.
- Design, implement, manage, and improve processes and data pipelines that collect data from operational data sources and external data producers, normalise, standardise, and enrich them, and make them available to data consumers in an accessible and discoverable manner
- Design, implement, manage, and improve the data security measures in place to make sure data consumers can access the data they need, but only what they need and not more.
- Make sure the produced data adheres to data quality measures and SLAs that make it appropriate to use by consumers
- Liaise with internal data producers and consumers to satisfy business requirements on a daily basis
Requirements
- In-depth familiarity with Snowflake and data modeling skills for analytical/transactional data systems
- Managing infrastructure, networking, and security on AWS using Terraform
- In-depth knowledge about workflow orchestrators, specifically Airflow or Dagster
- In-depth knowledge of Python and building data systems using Python. An understanding of API frameworks such as FastAPI and libraries such as Pydantic, and design, implementation, and deployment of APIs is preferred.
- Knowledge of CI/CD measures and tools, such as GitHub Actions
- Preferred: knowledge of Kafka, dbt or SQLMesh, deployment of data governance tools such as data quality or data catalogue solutions, deployment of semantic/metric layer solutions such as Cube with self-serve tools or data visualisation tools integration.
Benefits & conditions
- 1st: Initial Chat with Talent Partner (45 mins via Zoom)
- 2nd: Technical Interview including a Technical Assessment and Technical Discussion (1.5 hours via Zoom)
- 3rd: Values Interview including with Technical and Non-Technical team members (1 hour video via Zoom)
- 4th: Final interview including Technical focus with the Hiring Manager and Tech Leadership team (1 hour video via Zoom)
Why Legend
- Super smart colleagues to work alongside and learn from.
- Engaging development opportunities at all levels.
- Tailored flexibility for your work-life balance.
- Annual discretionary bonus to reward your efforts.
- Paid annual leave PLUS a well-deserved break to recharge your batteries during the festive season! Our offices are closed between Christmas and New Year's, allowing you to enjoy downtime without dipping into your annual allowance.
- Long term incentive plan so we can all share in the growth and success of Legend.
- Exciting global Legend events, where we unite in person to ignite our shared passion and unveil the exciting strategies for the year ahead!
- Unlock your full potential by joining the Legend team. To support you on this journey, we provide an extensive array of benefits and perks, as outlined in our global offerings above. For country specific benefits please reach out to your talent partner.
About the company
About LegendWe're Legend. The team quietly building #1 products that make noise in the most competitive comparison markets in the world. iGaming. Sports Betting. Personal Finance.We exist to build better experiences. From amplified career paths to supercharged online journeys for our people and our users, we deliver magic rooted in method. With over 500 Legends and counting, we're helping companies turbocharge their brand growth in over 18 countries worldwide.If you're looking for a company with momentum and the opportunity to progress at pace, Legend has it.Unlock the Legend in you.