EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
Senior Data Engineer
Infinity Quest
UK
16 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
£52,914.0
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Airflow
Amazon Web Services
Amazon S3
Microsoft Azure
Big Data
Computer Programming
Continuous Integration
Extract Transform Load (ETL)
DevOps
Python (Programming Language)
PostgreSQL
+11 more
NumPy
Scrum Methodology
Selenium
SQL Databases
Scripting
Apache Spark
Git
Pandas
Atlassian Bamboo
Jenkins
Databricks
Requirements
Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow -Preferred Domain: Energy trading
8+ years of experience in python scripting. Experience with python packages such as NumPy, pandas, polars beautiful soup, Selenium, Requests etc. Experience in building native python ETL pipelines for scraping/processing. Good to have experience in processing big data. Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have Knowledge on DevOps CI/CD like Azure Pipelines, Jenkins, Git. Experience working with AWS services(S3, lambda,etc) and Azure Databricks. Have experience in delivering project with Agile and Scrum methodology. Able to co-ordinate with Teams across multiple locations and time zones Strong interpersonal and communication skills with an ability to lead a team and keep them motivated. Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlists6:21 min
Investigating push inefficiencies with upstream Git experts
Jonathan Creamer · Coffee With Developers
2:34 min
Maximizing execution memory effectively via python numpy broadcasting
Jodie Burchell · LIVE
2:03 min
Accelerating pandas dataframes using cudf module plugins
Ankit Patel · World Congress 2024
3:03 min
Career evolution in data engineering and AI platforms
Maria Apazoglou · Coffee With Developers
3:33 min
Refactoring data science workflows using Rapids QDF and Pandas
Paul Graham · LIVE
56 sec
Favorite git commands and the importance of patch commits
Eileen Uchitelle +1 · Coffee With Developers
Videos
See allRelated articles
See all
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
EM
Eli McGarvie
Fullstack Developer Salary UK
over 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
EM
Eli McGarvie
Software Engineer Salary London
over 3 years ago