Senior Database & Cloud Data Engineer

Conferma
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Tech stack

API
Agile Methodologies
Azure
Cloud Computing
Information Systems
Databases
Continuous Integration
Data Validation
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Security
Data Systems
Data Warehousing
Database Design
DevOps
Disaster Recovery
Python
Microsoft SQL Server
Query Optimization
Azure
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Technical Data Management Systems
Unstructured Data
Data Processing
Data Storage Technologies
Azure
System Availability
Indexer
GIT
Microsoft Fabric
Data Lake
PySpark
Information Technology
Data Management
Azure
Software Version Control
Data Pipelines
Databricks

Job description

We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets.

You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL/ELT processes, and implement best practices for data governance, quality, and security.

The responsibilities include:

Data Engineering & Development:

  • Design, build and maintain high-performance data pipelines for ingestion, transformation, and storage using modern data tools and frameworks.
  • Develop scalable solutions for structured and unstructured data across hybrid environments (on-premises databases and cloud).
  • Maintain / implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric)
  • Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability.
  • Migrate and modernise legacy databases to cloud-based architectures.

Database Administration

  • Administer, monitor, and optimise database systems (e.g. SQL Server).
  • Ensure high availability, backup, recovery, and disaster recovery planning for critical databases.
  • Manage databases security, access control, and compliance with data governance policies.
  • Automate routine database tasks using scripts or DevOps tooling.

Cloud & Infrastructure

  • Architect and implement cloud data solutions using services such as Azure Data Factory or Azure Data Lake.
  • Integrate data from various cloud and on-premises sources into unified analytical platforms.
  • Collaborate with DevOps teams to manage CI/CD pipelines for data workloads.

Data Quality, Governance & Security

  • Develop and enforce data validation, cleansing, and quality monitoring processes.
  • Ensure adherence to GDPR and other data privacy regulations.
  • Working closely with Data Governance and Compliance teams to implement data stewardship practices.

Collaboration & Leadership

  • Mentor junior data engineers and provide technical leadership across projects.
  • Partner with business teams to translate requirements into technical data solutions. Stay current with emerging technologies in cloud, data engineering, and database management.

Requirements

Do you have experience in Scala?, * Educated to degree level or the equivalent in Computer Science, Information Systems, Data Engineering, or a related discipline.

  • Hands-on experience in database or data engineering roles.
  • Proven track record in designing and implementing cloud-based data solutions (preferably in Azure).
  • Expert-level SQL and database design (normalisation, indexing, query optimisation).
  • Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc.
  • Experience with Python, PySpark, or Scala for data processing.
  • Familiarity with CI/CD practices.
  • Experience with Data lake, Data warehouse and Medallion architectures.
  • Understanding of API integrations and streaming technologies (event hub).
  • Version control (Git), Agile Delivery, and DevOps best practices.
  • Excellent communication and stakeholder management skills.
  • Collaborative mindset with mentoring capabilities.
  • Relevant certifications are advantageous (e.g. Microsoft Certified: Azure).

Benefits & conditions

Salary & Bonus: Dependent on experience and skills

Benefits at Conferma:

At Conferma we understand that our people are what make us great. We have set out to provide a comprehensive benefits package that includes everything you would expect, as well as providing flexibility for you and your family.

  • A salary sacrifice pension to maximise your contributions
  • Life Assurance cover to provide peace of mind
  • Enhanced Company sick pay to put your mind at rest
  • Single cover private medical scheme, with the flexibility to add family members at your own cost
  • 25 days paid annual leave plus bank holidays, allowing you to focus on what's important to you outside of work
  • The ability to purchase up to 10 additional days holiday each year to enable additional time off
  • Additional paid time off for life events, such as moving house or getting married
  • An additional days leave on or around your birthday
  • Enhanced paid parental leave on the birth or adoption of your child
  • A confidential Employee Assistance program (EAP) available to all 24/7
  • Access a range of fantastic additional rewards, such as Cycle 2Work, Gym Membership, Tech Scheme and discounted shopping and Cinema tickets, via Conferma Rewards

Diversity, Equity and Inclusion

We are committed to ensuring equal opportunity for all. We intend that no job applicant or employee shall receive less favorable treatment, nor be disadvantaged by any conditions or requirements which are irrelevant.     If you require alternative methods of application or screening, you must approach the employer directly to request this as Indeed is not responsible for the employer's application process.

About the company

Conferma is a global payment technology company who combine innovation and expertise to push the boundaries of what can be achieved in the world of virtual payments. We were created in 2005 and were more recently acquired by Sabre, with additional investment from Mastercard. Over the past decade, the Conferma ecosystem has grown, enabling us to become the world's largest payments platform for virtual cards. We've engineered connectivity to over 90 of the world's best commercial card partners, over 400 travel management companies and over 150 travel technology partners. Every day, our team members work together to make it easier for travellers to connect with people and places. Our teams include passionate people dedicated to providing an environment that encourages partnership, a place where you feel like you belong, and where you are empowered to succeed. We look forward to having you join our journey - and seeing how far we can go, together!

Apply for this position