Senior Airflow/ Cloud Engineer (Workload Automation)

Deutsche Bank
Frankfurt am Main, Germany
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Birmingham, United Kingdom

Tech stack

API
Airflow
Macintosh Application Environment
Google BigQuery
Cloud Engineering
System Configuration
Data Flow Control
Job Scheduling
Python
PostgreSQL
Performance Tuning
Ansible
Cloudera
Software Engineering
Google Cloud Platform
Google Cloud Functions
REST
Terraform
Data Pipelines
ServiceNow
Control M

Job description

Service Automation provides an integrated set of management tools for IT professionals to programmatically provision and automate the operational maintenance of their hybrid application environment. It focuses on the following key capabilities:

Technology Operations Automation

Provisioning and Configuration

Workload Automation

Orchestration Development

This software engineering position is specifically focused within Workload Automation and is responsible for availability, latency, performance, efficiency, change management, monitoring, automation, emergency response, and capacity planning for the centralized platforms of Control-M, Automic, Airflow as well as Google services Cloud Composer, Workflows and Scheduler which are utilized across the Bank for workload automation/job scheduling/batch job management. This position will complement someone with a software engineering mindset, who is proficient coding with Python, has experience with API integration and orchestration, ServiceNOW integration and Ansible yaml development to proactively build and implement services for Control-M, Automic and Google Cloud Composer automation.

Working as an engineer you will bridge the gap between development and operations. Further, you will architect, design and develop new features as well as expand and support existing features. You are expected to learn new technologies based on what we already deploy while also learning new technologies that will enhance our offerings., * Demonstrate a wide range of technological expertise including Airflow, Google Cloud Platform, Control-M or Automic and a general understanding of industry practice around REST based API orchestration

  • Be an active, contributing engineer for the integration of Apache Airflow into the IT landscape by technically and organisationally helping to drive the adoption
  • Design and implementation of new concepts for improvement or replacement of existing processes, especially from Control-M or Automic towards Airflow or Google Could Composer
  • Integration, configuration, upgrade, maintenance and introduction of new capabilities to our critical Workload Automation products responsible for batch scheduling and API orchestration
  • Being able to design concepts and take over development activities, identify automation opportunities as well as solutions in a self-reliant manner
  • Sound and relevant Airflow or Workload Automation architecture experience is a must

Requirements

  • Experience with Workload automation tooling, preferably Apache Airflow, Control-M and/or Google Cloud Composer using standard agile SDLC techniques
  • Experience in developing guidelines for Airflow clusters and DAG's, working knowledge of performance tuning of the DAG's and task implementation, developing DAG - data pipeline to on-board and change management of datasets
  • Experience with installing, configuring and monitoring Airflow cluster, strong Python
  • Understanding of Airflow rest services and integration of Airflow ON A platform eco-system
  • Hands on experience in Google Cloud Platform using following GCP services Terraform, Cloud Composer, BigQuery, Dataflow, Cloud Functions, Dataproc, Google Transfer Service, Postgres

Benefits & conditions

Pulled from the full job description

  • Employee discount
  • Company pension
  • Paid volunteer time
  • Private medical insurance
  • Discounted gym membership, A healthy, engaged and well-supported workforce are better equipped to do their best work and, more importantly, enjoy their lives inside and outside the workplace. That's why we are committed to providing an environment with your development and wellbeing at its centre.

You can expect:

  • Hybrid Working - we understand that employee expectations and preferences are changing. We have implemented a model that enables eligible employees to work remotely for a part of their working time and reach a working pattern that works for them
  • Competitive salary and non-contributory pension
  • 30 days' holiday plus bank holidays, with the option to purchase additional days
  • Life Assurance and Private Healthcare for you and your family
  • A range of flexible benefits including Retail Discounts, a Bike4Work scheme and Gym benefits
  • The opportunity to support a wide ranging CSR programme + 2 days' volunteering leave per year

About the company

For over 150 years we have been there for our clients every step of the way. Our purpose: ‘Dedicated to our clients’ lasting success and financial security at home and abroad’ guides our vision and strategy, and is brought to life by our culture. With a global presence in about 60 countries, and a diverse workforce of more than 90,000 people, we know that each individual’s daily actions shape our culture. 

Deutsche Bank Technology in Berlin

DB Technology is a global team of tech specialists, spread across multiple trading hubs and tech centres. We have a strong focus on promoting technical excellence – our engineers work at the forefront of financial services innovation using cutting-edge technologies.

Our Berlin location is our most recent addition to our global network of tech centres and growing strongly. We are committed to building a diverse workforce and to creating excellent opportunities for talented engineers and technologists. Our tech teams and business units use agile ways of working to create #GlobalHausbank solutions from our home market.

Apply for this position