Senior Data Engineer

Made Tech
UK
1 day ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Experience level
Expert
Experience required
5 years minimum
Compensation
£60,000.0 - £75,000.0
Working hours
Regular working hours

Tech stack

Geographic Information Systems Artificial Intelligence Airflow Amazon Web Services Data Analysis Unit Testing Microsoft Azure Software Quality Databases Data Architecture Data Cleansing Information Engineering
+22 more
Extract Transform Load (ETL) DevOps JSON Python (Programming Language) Machine Learning Pair Programming DataOps Software Engineering Data Streaming Parquet Data Logging Data Processing Virtual Environment Git Pandas Infrastructure Automation Frameworks AWS Glue Data Management Terraform Software Version Control Docker Programming Languages

Job description

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders., As a Senior Data Engineer, your day to day tasks and role may vary according to our clients’ needs. The role is very hands-on and you’ll support as a senior contributor for a project, focusing on both delivering engineering work as well as upskilling members of the client team. You’ll need to have a drive to deliver outcomes for users. You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution. As a member of the Data and AI Practice within Made Tech, you will also participate in the continued development of the practice, as well as representing us both internally to the organisation and publicly via presentations. You’ll need to have a drive to deliver outcomes for users and have a desire to share your knowledge and participate in skill transfer sessions.

Requirements

  • Hands-on and knowledge of programming languages particularly Python
  • Practical experience with major cloud providers including GCP, Azure, or AWS
  • Knowledge of core software engineering concepts like DRY and SOLID
  • Proficiency in version control systems, specifically Git or similar tools
  • Demonstrated application of TDD and diverse testing methodologies, such as data quality, integration, and unit testing
  • Ability to leverage CI/CD pipelines to maintain code quality and facilitate deployments
  • Knowledge of Data Engineering fundamentals, including Batch/Streaming and ETL/ELT
  • Familiarity with various data architectures, such as Lakes and Warehouses
  • Hands-on experience with data cleansing and transformation within unified, standardised schemas

Technologies While mastery of every tool is not required, we are seeking Engineers who have experience with one or more of the following technological areas:

  • Analytics & Platform Frameworks
  • Orchestration like Airflow or AWS Glue
  • Database Technologies
  • Data processing libraries & Schema Management tools like Pandas and Pydantic
  • Storage Formats: Familiarity with data types such as JSON and Parquet

DevOps and DataOps

  • Experience of IaC tools, particularly Terraform
  • Understanding of implementing logging, monitoring and alerting for enterprise level pipelines
  • Understanding of access controls, policies and approaches

Consultancy Skills

  • Enthusiasm for learning and self-development and sharing that within a team and organisation
  • Knowing how to gather basic requirements from clients and users on a data project and turn those into demonstrable outcomes
  • Knowledge of how to document and diagram systems being built
  • Great communication skills to explain and relate concepts to stakeholders of different levels
  • Able to help coordinate with Product and Delivery managers

Desirable experience

Experience in the following things isn’t essential, but it’s highly desirable!

  • Working at a technology consultancy
  • Working with Docker and virtual environments
  • Experience with specialised Data Platforms focused on specific domains like Geospatial data
  • Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models
  • Working knowledge of statistics
  • Working with multidisciplinary digital and technology teams
  • Working within the public sector
  • Demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders by identifying problems and opportunities, An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we’re looking for all successful candidates for this role to have eligibility.Eligibility for SC requires 5 years’ of continuous UK residency. Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won’t be able to progress your application and we will contact you to let you know why.

Benefits & conditions

When you apply, we’ll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. We’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from our blog, where we talk about mental health, communities of practice and neurodiversity (as well as our client work and best practice). Like many organisations, we use Slack to foster a sense of community and connection. As well as special interest groups such as music, food and pets, we also have 10+ Slack channels dedicated to specific communities, allies, and identities as well as dedicated learning spaces called communities of practice (COPs). If you’d like to speak to someone from one of these groups about their experience as an employee, please do let a member of the Made Tech talent team know.

Benefits We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We’ve recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of our most popular benefits listed below: ️ 30 days Holiday - we offer 30 days of paid annual leave + bank holidays! Flexible Parental Leave - we offer flexible parental leave options Remote Working - we offer part time remote working for all our staff Paid counselling - we offer paid counselling as well as financial and legal advice.

About the company

At Made Tech we want to positively impact the future of the country by using technology to improve society, for everyone. We want to empower the public sector to deliver and continuously improve digital services that are user-centric, data-driven and freed from legacy technology. A key component of this is developing modern data systems and platforms that drive informed decision-making for our clients., At this point, we hope you’re feeling excited about Made Tech and the job opportunity. Even if you don’t feel that you meet every single requirement, we still encourage you to apply. Get in touch with our talent team if you’d like an informal chat about the role and your suitability before applying. We are hiring for this role directly, so will not respond to any CVs sent via external recruitment agencies. An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we’re looking for all successful candidates for this role to have eligibility.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 · Coffee With Developers

Videos

See all

Related articles

See all