data engineer for rail industry

Enfint

London, UK

3 days ago

Apply on www.collegerecruiter.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.collegerecruiter.com

Tech stack

Application Programming Interfaces (APIs) Airflow Amazon Web Services Data Analysis Microsoft Azure Data Validation Information Engineering Data Governance Data Retrieval Data Systems Github Python (Programming Language)

+13 more

PostgreSQL Microsoft SQL Server Performance Tuning Query Optimization Power BI Software Construction SQL Databases Git Fastapi Information Technology Software Version Control Data Pipelines Databricks

Job description

Ensure data for downstream applications is reliable, accessible, and appropriately formatted through engagement with Product Management and stakeholders
Plan and drive the development of data solutions while balancing functional and non-functional requirements
Advise on approaches to novel data problems using Python-based solutions
Apply data standards and architectures to deliver reliable and well-engineered solutions
Conduct complex data quality checks and monitoring, and perform remediation to maintain data integrity
Maintain and optimise data pipelines, APIs, and applications for performance and reliability
Develop quick prototypes and high-quality products according to the context
Design, code, test, and document complex data engineering scripts and applications using SQL, Python, and software engineering best practices
Collaborate with Product Management and stakeholders to understand business requirements and translate them into technical solutions
Communicate technical concepts and solutions to technical and non-technical audiences
Mentor and coach colleagues on problem-solving approaches and deliverable quality

Requirements

Hold a BSc in a scientific, computer science, or related discipline
Have extensive experience with data analysis, data modelling, and quality assurance techniques
Proficiency in SQL and Python
Experience developing Python data pipelines with orchestrators such as Airflow
Experience making data available in data science and data visualisation tools such as Databricks and Power BI/Fabric
Experience extracting data from various systems, including familiarity with web-oriented architecture
Ability to analyse and document technical solutions effectively
Communicate effectively and share ideas with audiences using appropriate methods
Adapt effectively to new opportunities, change, and uncertainty
Contribute actively to team goals and outcomes
Take responsibility and accountability for completing tasks and achieving objectives
Resolve problems and identify opportunities proactively
Demonstrate commitment to customer service and customer satisfaction
Collaborate within an evolving industry and build stakeholder confidence through subject-matter expertise
Make timely and informed decisions while considering benefits and constraints
Nice to have: Experience developing and deploying Python APIs with frameworks such as FastAPI, familiarity with AWS, Azure, or GCP, experience with Git-based version control and repositories such as Azure DevOps Repos or GitHub, experience with Microsoft SQL Server or PostgreSQL including query optimisation and performance tuning

Benefits & conditions

30 Days annual leave plus bank holidays
Private medical and dental cover
Season ticket loan and travel subsidy
Cycle to work scheme
Volunteer leave
Performance-related bonus
Pension scheme
Learning and development opportunities
Core hours with the option to vary the working location between the office and home
Permanent role based at the Fenchurch Avenue office