AWS Data Engineer

American IT Systems

London, UK

2 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

10 years minimum

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Java (Programming Language) Amazon Web Services Microsoft Azure Databases Data Architecture Data Integration Extract Transform Load (ETL) Data Mining Data Systems Data Visualization Data Warehousing Database Development

+21 more

Apache Hadoop Python (Programming Language) Machine Learning NoSQL Scrum Methodology Power BI Cloud Services Software Engineering SQL Databases Tableau (Software) Talend Workflow Management Systems Google Cloud Apache Spark Information Technology AWS Data Analytics Apache Kafka Spark Streaming Data Management Stream Processing Data Pipelines

Job description

We are seeking a skilled and experienced Data Engineer to join our dynamic team. In this role, you will be responsible for developing, testing, improving, and maintaining new and existing databases to help users retrieve data effectively. As a data engineer, you will work closely with our data team to optimize our data systems and pipeline architecture, develop set processes for data mining, data modeling, and data production. The ideal candidate should be an analytical problem solver, have a deep understanding of data relationship complexities, and be able to strategize and implement database solutions that support and enhance our company’s data systems and data quality.

Responsibilities

Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.

Discover opportunities for data acquisition and new uses for existing data.

Develop data set processes for data modeling, mining, and production.

Employ a variety of languages and tools to marry systems together or try to hunt down opportunities to acquire new data from other systems.

Requirements

Proficiency in SQL and NoSQL databases.

Strong knowledge of Python, Java, or Scala.

Experience with data pipeline and workflow management tools.

The candidate must have a Bachelor’s degree in Computer Science, Software Engineering, or a related field. A Master’s degree or further education in Data Science or a related field is preferred.

Preferred Skills

Familiarity with cloud services like AWS, Google Cloud, or Azure.

Experience with big data tools: Hadoop, Spark, Kafka, etc.

Knowledge of data integration tools like Informatica, Talend, etc.

Understanding of machine learning algorithms and statistics.

Experience with data visualization tools like Tableau, PowerBI, etc.

Knowledge of data warehousing solutions and ETL tools.

Familiarity with data architecture and data modeling techniques.

Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Knowledge of software development methodologies like Agile/Scrum.

Understanding of data privacy and governance.