Data Engineer
Role details
Job location
Tech stack
Job description
As a Data Engineer, you will work closely with Product Managers, Data Analysts, and fellow Data Engineers to design and build systems that extract, transform, and deliver Creditsafe data.
You'll be responsible for defining and building data pipelines that enable faster, smarter, data-informed decision-making across the business and for our customers. This role offers exposure to distributed data architectures in AWS , working on scalable and high-performing data platforms., * Work as part of an Agile team to develop, test, and maintain high-quality data processing systems that meet business needs
- Extract data from a variety of sources, including relational databases, files, and APIs
- Help evolve our data platform with a focus on scalability, growth, and high throughput
- Apply engineering best practices such as continuous integration and test-driven development to support rapid delivery
- Design and build metadata-driven data pipelines using Python and SQL , in line with Data Architecture guidelines
- Independently deliver medium to large features , using industry-standard data processing patterns
The responsibilities listed above are not exhaustive, and you may be asked to take on additional reasonable duties as required by your line manager.
Requirements
Do you have experience in Test-driven development?, * Experience designing and building autonomous, fault-tolerant data pipelines
- Strong commercial experience developing production-grade ETL and ELT pipelines in Python
- Experience implementing data architectures in analytical data warehouses such as Snowflake, Redshift, or BigQuery
- Hands-on experience with data orchestration tools such as Airflow
- Knowledge of Agile development methodologies
- Awareness of cloud technologies , particularly AWS
- Understanding of automated delivery and CI/CD processes
- Strong engineering fundamentals, including error handling, logging, monitoring, and fault-tolerant design
- Ability to write efficient code and carry out performance optimisation and tuning
- Comfortable working with relational databases such as Oracle, PostgreSQL, and MySQL
- Exposure to dbt and data quality testing frameworks
- Awareness of Infrastructure as Code tools such as Terraform and Ansible
Benefits & conditions
Pulled from the full job description
- Annual leave
- Company pension
- Cycle to work scheme
- Company events, * Competitive salary
- Company laptop provided
- Bonus scheme
- 25 days annual leave plus bank holidays
- Hybrid working model
- Healthcare and company pension
- Cycle to Work and wellbeing programmes
- Global company gatherings and events
- E-learning and excellent career progression opportunities
- Plus more - see the full benefits package on our Careers page:
- https://careers.creditsafe.com/gb