Data Engineer
Role details
Job location
Tech stack
Job description
- Design, develop, and maintain high-quality, scalable, and secure data and analytics solutions aligned with business goals
- Collaborate with business and IT teams to deliver data-informed strategies and solutions
- Lead full SDLC execution and continuous improvement using Agile practices
- Build and maintain advanced, testable, and reusable data products
- Perform data analysis, solution design, development, testing, and integration
- Troubleshoot and enhance existing data systems
- Mentor team members and incorporate external data to enrich datasets
Requirements
The Senior Data Engineer, will design, build, and deploy scalable data engineering solutions that enable data required to build and solve real business problems across underwriting, risk, and operations. They will be joining an established squad that has in flight work and commitments around moving, ingesting, and provisioning data not just from SQL databases but also from external sources such as CSV files or API's. We need someone very comfortable in data processing particularly around ETL processes using Informatica (cloud) and SSIS. The successful candidate must be comfortable in moving/souring data between SQL-to-SQL databases along with SQL to Snowflake, utilising S3 storage to create centralised reusable data sets. Proficient in MS SQL to create stored procs, views and triage, optimise and update existing code as needed based on new or updated requirements.
Must be proficient in creating the required data sets/data products and in turn designing/building reports within Tableau/Power BI. Must be confident in communicating directly with business stakeholders and as part of an agile team to define requirements, enable the data needed and validate the outputs confidently/accurately. Beyond the technical build, they will collaborate closely with product owners, underwriters, business users, data scientists, and data engineers to translate real-world requirements into practical solutions., * Requires a BS/BA degree or equivalent experience.
Technical Skills:
- 5+ years experience with SQL.
- 3+ Experience with R, Python
- Experience with ETL/ELT tools such as Informatica Cloud, SSIS etc.
- Experience with BI tools not limited to Tableau, SSRS, PowerBI, Quick sight Business Objects, LOGI etc.
- Experience with Snowflake would be preferred.
- Distinct advantage experience with Dataiku
- Experience with Web Application Development would be preferred
- Experience with AWS would be preferred
- Experience with DevOPS and Data pipelines would be preferred
