Data Engineer

• Define and shape the way we build and transform our audit data products.
• Support front-end Attribute Reputation services (APIs) by providing attribute insights for fraud detection and prevention.
• Operate, maintain, and improve our pipelines and channels.
• Munging large data sets from multiple sources, including audit data captured from Digital Services.
• Collaborate with a multidisciplinary team to provide data business solutions, including publishing and sharing data.
• Create and produce Jupyter notebooks.
• Perform data processing, validation, and cleansing.
• Summarize and enrich data sets for convenient use by consumers.
• Set up, maintain, and improve automated data processes.
• Help others understand our work through co-participatory design, pairing, demos, and documentation.
• Work cross-discipline and contribute to improvements for the greater good of CIP.

Technologies:

• AWS
• ETL
• Support
• Jupyter
• Python
• SQL
• Spark
• Cloud
• Security

• Active SC Clearance with a government body is required.
• Data analysis experience.
• Data transformation and ETL experience.
• Database experience.
• Understanding of data science principles.
• AWS suite experience.
• Ability to return services to good states in outage situations.
• Understanding of testing and automation.
• Experience working in a lean, agile environment.
• Experience working in a you build it, you run it team.
• Experience coding in a continuous integration context.
• Essential skills and technologies: Python, Spark, SQL, database experience, AWS Suite., We are seeking a Data Engineer to support our client on a project. The role is fully remote and sits inside scope of IR35 at a rate of £489 per day. We value proactive, responsible, motivated self-starters with a user-centric attitude who prioritise people over processes, drive lean results, and advocate doing the right thing. Our team works collaboratively with regular pairing, thoughtful course-correction, simple maintainable code, and a willingness to work across disciplines. We encourage creativity, evidence-driven decision-making, and a focus on testing, automation, reliability, and continuous improvement.