Data Engineer

Aligne Technologies Ltd
Charing Cross, United Kingdom
19 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 130K

Job location

Charing Cross, United Kingdom

Tech stack

Agile Methodologies
Data analysis
Application Lifecycle Management
Software Applications
Azure
Big Data
Cloud Computing
Databases
Data as a Services
Data Systems
Relational Databases
Database Queries
DevOps
Python
PostgreSQL
Microsoft SQL Server
Software Architecture
Software Engineering
Azure
Spark
Data Pipelines
Databricks

Job description

  • Solution Design & Implementation: Design, implement, and maintain reliable and scalable software applications and data systems, with a strong focus on using Python as the primary development language.
  • Data Pipeline Development: Utilize proven expertise with Apache Spark/Databricks and Azure Data Factory to build, optimize, and manage robust and efficient data pipelines.
  • Database Management & Analysis: Serve as an expert in data analysis and querying, demonstrating strong database query skills in platforms like SQL Server/PostgreSQL.
  • Production Support: Provide critical business support for production systems, including in-depth analysis and timely troubleshooting of problems, interacting with internal teams and business users throughout the application lifecycle.
  • Collaboration & Teamwork: Work effectively with geographically diverse delivery groups (Business Analysts, QA Engineers, and Developers) and DevOps teams to ensure the delivery of high-quality solutions.
  • Continuous Improvement & Innovation: Actively research and develop innovative technologies, striving for excellence and continuous improvement in software architecture, embracing Agile methodologies and building systems.
  • DevOps and Agile Practice: Adhere to and champion the Agile methodology. Actively contribute to building DevOps maturity, ensuring the safe and reliable delivery of business incremental change and measurably improving delivery velocity.

Requirements

Do you have experience in Python?, We are seeking a highly experienced and motivated Senior Data & Software Engineer with a strong background in solution design, implementation, and data-intensive applications. The ideal candidate will possess deep expertise in Python, Apache Spark/Databricks, and the Azure data ecosystem, and will be a key player in developing reliable, scalable data applications while actively contributing to our DevOps maturity and Agile delivery process., * Overall Experience: Minimum of 6+ years of professional experience in software engineering, specifically in solution design and implementation.

  • Python Expertise: 6+ years of hands-on software engineering experience in solution design and implementation using the Python software development language.
  • Big Data Technologies: Proven expertise and practical, hands-on experience with Apache Spark and Databricks.
  • Cloud Data Services: Strong experience with Azure Data Factory (ADF).
  • Database Proficiency: Expert knowledge of data analysis and querying in relational databases such as SQL Server and/or PostgreSQL, with strong database query optimization skills.
  • Methodologies: Deep understanding and experience working within Agile frameworks and building DevOps practices.
  • Communication: Excellent communication and collaboration skills for interacting with cross-functional and global teams.

Apply for this position