Data Engineer
Role details
Job location
Tech stack
Job description
Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the UK on an ad hoc basis)
Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside of the UK) and declaration of being a British passport holder with no dual nationalism at the point of application., * Deploy machine learning models to production and implement measures to monitor their performance
- Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice
- Define, document and iterate data mappings based on concepts and principles of data modelling
- Re-engineer data pipelines to be scalable, robust, automatable, and repeatable
- Navigate, explore and query large scale datasets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- Identify and resolve data issues including data quality, data mapping, database and application issues
- Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems
- Deliver high quality implementation and documentation for critical functionality
- Deliver code, unit tests, feature tests, stubs and integration tests.
- Operate in an agile environment as part of a scrum team and participate in sprint rituals
- Work with team members to understand designs, functional requirements and triage issue
- Stay engaged with the latest technological developments, especially in the fields of generative AI
Requirements
We have a number of opportunities available from junior to senior level and we are looking for data engineers who have a variety of different skills which include some of the below. * Strong proficiency in Python
Extensive experience with cloud platforms (AWS, GCP, or Azure)
Experience with:
o Data warehousing and lake architectures
o ETL/ELT pipeline development
o SQL and NoSQL databases
o Distributed computing frameworks (Spark, Kinesis etc)
o Software development best practices including CI/CD, TDD and version control.
o Containerisation tools like Docker or Kubernetes
o Experience with Infrastructure as Code tools (e.g. Terraform or CloudFormation)
- Strong understanding of data modelling and system architecture
- Demonstrable experience on at least one AI/ML project
- Knowledge of common machine learning frameworks and models
- A good understanding of approaches to monitoring ML models in production
As a technology consultancy, we look for people who can deliver both exceptional technical solutions and work as true partners to the organisations we support. To do this you must be able to:
- Communicate effectively verbally and in writing, demonstrated through:
o Effectively explain complex technical solutions to a non-technical audience
o Writing meaningfully to deliver clear information, and guidance
o Giving impactful presentations, articulating clearly key points
- Demonstrate critical thinking by:
o Analysing and evaluating information
o Using information gathered to present solutions and reach decisions
o Displaying familiarity and comfort with a breadth of technologies (appropriate to the level of the role) and an appreciation of how they can be combined and applied to solve customer problems * Work in partnership with others to:
o Effectively manage both internal and external stakeholders to ensure synergy
o Collaborate meaningfully with all parties to ensure outcomes are reached effectively
Whilst having experience in a consultancy is beneficial, demonstrable experience in working with clients/external partners in other settings will always be considered.
Benefits & conditions
Salary: Competitive salary and package (Depending on level of experience), At Accenture in addition to a competitive basic salary, you will also have an extensive benefits package which includes 25 days' vacation per year, private medical insurance and 3 extra days leave per year for charitable work of your choice!
Flexibility and mobility are required to deliver this role as there will be requirements to spend time onsite with our clients and partners to enable delivery of the first-class services we are known for.