Senior Data Engineer - Python/SQL
Harvey Nash
Charing Cross, United Kingdom
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 143KJob location
Charing Cross, United Kingdom
Tech stack
Amazon Web Services (AWS)
Automation of Tests
Cloud Computing
Software Quality
Code Review
Graph Database
Python
Scrum
Software Engineering
SQL Databases
Cloudformation
Pandas
PySpark
Information Technology
Terraform
Job description
- Develop creative, forward-thinking solutions to meet business needs, exploring options beyond existing approaches to deliver resilient, scalable outcomes.
- Design and implement pipelines for Real Time analysis and critical operational decision-making.
- Build end-to-end ELT pipelines, from sourcing data to presenting clear outputs for internal customers.
- Write high-quality, testable, readable code; participate in code reviews; support solution design; build automated tests; and contribute to documentation throughout the development life cycle.
- Collaborate closely with developers, a Scrum Master, and a Product Owner to ensure data effectively enables the client experience.
- Contribute to continuous improvement of technical standards, engineering practices, technologies, and processes.
- Own deployment and operational responsibilities across development, test, and production environments.
- Participate fully in agile ceremonies, including sprint planning, daily stand-ups, sprint reviews, and retrospectives.
Requirements
- Bachelor's degree in Computer Science, STEM, or a related field is beneficial but not essential.
- Proven experience as a Data Engineer.
- Strong proficiency in Python and SQL, with solid experience working in cloud environments (AWS preferred).
- Skilled in transformation tools such as PySpark or Pandas.
- Knowledge of graph databases is an advantage but not required., * Experience using data quality frameworks (eg, Great Expectations).
- Hands-on experience building cloud infrastructure using IaC tools such as CloudFormation or Terraform.
- Strong understanding of software development best practices, including testing, code quality, and consistency.
- Excellent communication skills with the ability to translate technical information for non-technical stakeholders.
- Experience working within agile environments; familiarity with the Scrum framework is a plus.
- A growth mindset and a desire to develop both technically and professionally.