Data Engineer - Cloud

The role of Data Engineer is a pivotal one within the data team, and we are seeking candidates with experience of implementing data pipelines, data storage solutions, data processing and data integration architectures utilising the Microsoft Data Services Portfolio that solve our customers data challenges, enabling advanced analytics and business intelligence.

The ideal candidate will possess demonstrable expertise in leveraging Azure's extensive suite of tools and services to build scalable, secure and efficient data solutions that allow our customers to unlock real business value from their data. Security clearance or the willingness to apply will be required for this role., * Design, implement and maintain data pipelines, ETL/ELT processes, and data integration and transformation solutions using Azure Data Factory, Azure Synapse, and other relevant tools, working closely with the data architects and other data stakeholders.

• Ensuring pipeline execution, availability, and reliability across platforms.
• Implement and manage scalable data storage systems using Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, and Azure Blob Storage.
• Ensure data quality and integrity through effective metrics and monitoring processes.
• Utilize big data technologies like Azure Databricks and Apache Spark to handle and analyse large volumes of data.
• Develop strong technical relationships with customers and ensure that SCC are always perceived to be valued advisors.
• Ensuring that all design and implementations follow information security best practices and any information assurance compliance requirements.
• Able to stay updated on industry trends, emerging technologies, and best practices in cloud-centric data environments. Pursue training and certifications to enhance skills and knowledge.
• Develop and maintain comprehensive documentation for data pipelines processes and solutions, ensuring clarity and consistency.
• Able to adhere to Data Governance practices and confidently articulate them to stakeholders.

Do you have experience in Spark?, * Demonstrable evidence of working with customers to implement data solutions resulting in successful business outcomes.

• Excellent communication (verbal & written), organisational, data interpretation, analytical, presentation, interpersonal, and technical documentation skills.
• Proven multi-year experience in a Data Engineering role with a strong understanding of architecture frameworks, data modelling and data transformation, ideally obtained within an MSP environment.
• In-depth knowledge and practical experience with Microsoft Data Services Portfolio including PowerBI, SQL, Azure Data Factory, Azure DataLake, Databricks, Azure functions, Logic Apps, and Synapse. Ideally some experience with Microsoft Fabric. Azure certifications such as Azure\Fabric Data Engineer Associate and Azure Database Administrator Associate would be valuable. A good understanding and practical knowledge of NoSQL technologies would also be beneficial.
• Proficiency in PowerBI for data visualization and analysis.
• Logical and process orientated; ability to understand the customer's data requirements and challenges.
• Ability to create high-quality configuration documentation, outputting clear, consistent, and comprehensive artifacts.
• Flexibility - Comfortable with evolving solutions and finding the most effective path to implementation, working best in an environment of rapid change. Ideally some experience in Agile development methodologies.
• Analytical - Given a problem you'll dig to find possible solutions, and work with your team when needed. Able to transform complex raw data into meaningful information.
• Hands on experience in programming languages such as SQL, Python, or Scala.
• Must be able to obtain the Government and/or Police Security levels required to meet the operational requirements of the role (no caveats) and as per the requirements stipulated in relevant customer contracts.
• Technically creative and open-minded, Passionate about both technology and process improvement, with a focus on delivering value.
• Any exposure to machine learning and artificial intelligence would be an advantage.

Salary Package: £55,000 - £67,500 plus large company benefits, a broad flexible benefits scheme, and 2 paid-for volunteering days a year Hours: 9.00 am - 5.30 pm, Monday - Friday Interview Process: 2-stage process

Why SCC?

• An inclusive workplace
• Excellent package: solid basic and company benefits
• Hybrid working & core hours in line with role requirements
• Career development and life-long learning opportunities
• Opportunity to join Europe's largest privately-owned IT Company

Specialist Computer Centres are Europe's leading provider of IT services and solutions. Demand for our Data services continue to grow both from existing and new customers creating a real career opportunity for a talented individual to join our team., SCC is Europe's largest privately-owned IT business, based out of the new £7m HQ office in Birmingham and we help clients succeed through IT transformation and exceptional customer experiences. We are a business where innovation is greater as we combine unique ideas, people and disciplines. We are a global company that is passionate about IT and where we look to simplify the complex. We are an equal opportunities employer SCC is committed to providing equal opportunities and a proactive and inclusive approach to equality and diversity in employment. No applicant or employee will be treated less favourably than another on the grounds of a protected characteristic which are defined as sex, sexual orientation, age, disability, gender reassignment, trade union membership or non-membership, marriage and civil partnership, pregnancy and maternity, race and religion or belief. If you are selected for interview, and need any reasonable adjustments made for your interview, please let the SCC Talent Acquisition team know, at the point of scheduling. Diversity & Inclusion at SCC - https://www.scc.com/diversity-and-inclusion/ Sustainability at SCC - https://www.scc.com/sustainability-at-scc/ Life at SCC - https://www.linkedin.com/company/scc/life   You must create an Indeed account before continuing to the company website to apply