Data Engineer

I’m looking for a Data Engineer who can support our client on a project. The rate is £489 per day inside scope of IR35. This role requires someone who already has active SC Clearance with a government body. The role is fully remote working. Anyone who doesn’t have SC Clearance will not be considered. Your new role Role descriptionAs a Data Engineer in the AttRep Team you will define and shape the way we build and transform our audit data products. These data products will be used by our front-end Attribute Reputation services (APIs) to provide attribute insights for fraud detection and prevention across the company. It is vital that CIP Data Engineers are as equally committed to operating, maintaining and improving our pipelines and channels as they are to creating the forward-looking features. We live by the ‘You build it, you run it’ ethos. We would like to develop good software engineers with an interest in working on a data platform as CIP Data Engineers. The sheer scale of information our data products provide CIP Data Engineers with the opportunity to explore cutting edge & emerging technologies. Engineers should be comfortable reaching out to technology communities in order to learn, share and create new possibilities for our data products. Whether this is focussed on improving the quality of the data we capture or how we summarise and present that data to different audiences, creativity and imagination is a must. CIP Data Engineers must understand the importance of testing, automation and repeatable reliability, for all of the things we build and run. This work involves:?Munging large data sets from multiple sources, including audit data captured from Digital Services?Collaborate with multidisciplinary team to provide data business solutions, including publishing data and sharing data?Creating and producing Jupyter notebooks?Data processing, validation and cleansing?Summarizing and enriching data sets for convenient use by consumers?Set up, maintain and improve automated data processes Desired behaviours?Be proactive

?Responsible and motivated self-starter ?User centric attitude ? Prioritise people over processes ? Drive lean results; understand the value of iterative delivery ? Be evidence driven ? Advocate for ‘doing the right thing’ ?Help others understand your work through co-participatory design, pairing, demos and documentation ?Make complex look and sound simple ?Be kind, creative and convincing How we work:We favour:?Breaking down a high-level problem as a team upfront and delivering the core value first?Delivering individual business benefits to production, rather than bundling tasks together?Collaboration, communication, regular pairing and thoughtful course-correction?Taking the time to write simple and easy to maintain code?Willingness to make and participate in improvements for the greater good of CIP?Working cross-discipline rather than adhering to tightly defined roles. Knowledge & experience?Security clearance (SC-level)?Data Analysis?Data Transformation and ETL?Databases?Understanding of Data Science principles?AWS suite experience?Skilled at returning services to good states in outage situations?Understands the importance of testing and automation?Working in a lean, agile environment?Working in a ‘you build it you run it’ team?Experience coding in continuous integration context Skills & technologiesEssential: ?Python?Spark?SQL?Database experience?AWS Suite

What you’ll need to succeed You will need to have active SC Clearance with a government body