Senior Data Engineer (Permanent)
Role details
Job location
Tech stack
Job description
- You will work with various stakeholders from teams across clients we work at, including engineering, architecture, Senior Management and CxO level personnel.
- You will work with External parties that work with our client, such as our partners, or other consultancies that may be working with the client.
- You will be contribute to excellent quality and value for our clients.
- You will use your experience in different situations and with different products, to assess the needs of the business that are appropriate for them.
- Delivering informed opinions and approaches, which should be backed-up by your knowledge and/or research. Advice must be tailored to our Clients and be realistic for delivery., As a Senior Data Engineer of LEIT Data, you'll be assigned to various Client projects to lead and/or deliver data platforms following modern best practices.
Tasks will be varied and can be solo or team based deployments.
In all situations, you will operate as a professional consultant, addressing tasks at hand and continuously adding value in observations and best practice.
You will have support and access to LEIT resources and our strategic partners.
You will get the opportunity to learn and develop both your consultancy and data skills, with a primary focus around Snowflake and its ecosystem.
- Collaborate with our clients to design and build modern data platforms using a variety of technologies
- Help lead the design and implementation of complex, cloud-based data ingestion and transformation pipelines
- Implement scalable and secure Data platforms
- Mentor and upskill other engineers, both client and internal
- Help drive effective development patterns and delivery practices
- Help maintain and improve our internal tools and design patterns
- Continually improve with our internal development program, including mentoring and paid training / certifications, * You will have the opportunity to explore new features and functionality across various vendor products either as part of Client implementations or through our strategic partners.
- You will also have the opportunity as we grow to potentially manage larger teams, and work on internal R&D projects which can be "product" based and/or for optimisation/automation purposes.
- You will have opportunity to work alongside leading professionals in the Data industry
Requirements
An experienced Data professional or engineer with consultancy skills and a focus on Snowflake, modern data tools (dbt, airflow, python etc.) and modern data practices (Data Products, Data Mesh, ETL, CICD, DataOps etc.).
- 3 years+ experience with Snowflake
- Skilled in dbt, airflow (or similar tool) and Snowflake.
- 4 years+ experience with AWS or Azure
- Problem solving and consultancy skills
- Experience with SDLC, CICD, DevOps and DataOps processes
- Experience across Designing, Implementing and Managing Data platforms, including Data Governance, Observability and Automation
- Strong communication skills, including stakeholder management up to CXO level
- You'll be able to help understand business requirements, and translate those into technical requirements, design patterns and stories for development.
- Able to lead Engineering teams, where required.
- Providing mentoring and guidance to less knowledgeable Engineers, * Hands-on experience and highly proficient in Snowflake
- SnowPro Core certified (or completing in the first 3 months after joining LEIT, looking to complete advanced cert in the medium term)
- Ideally certified in AWS and/or Azure.
- Advanced SQL skills, including query optimisation
- Experience in the modern Data Stack eg dbt, Airflow or similiar technologies
- Preferably, experience working with the following:
- Python
- Containers (Docker preferred)
- CI\CD Pipelines
- Infrastructure as Code
- Real-time / event-based data
- Data quality frameworks
- Cloud Platforms
- Data Migration
- Other skills:
- Ability to work in Agile ways
- Working knowledge of data regulations (e.g. GDPR)
- Good understanding of the SDLC