Big Data Engineer
Information Tech Consultants
UK
24 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
£35,000.0 - £45,000.0
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Big Data
Cloud Computing
Databases
Information Engineering
Data Integration
Extract Transform Load (ETL)
Data Transformation
Data Mining
Data Systems
Data Warehousing
+15 more
Software Debugging
Distributed Computing Environment
Apache Hadoop
Apache Hive
Python (Programming Language)
NoSQL
SQL Databases
Data Processing
Google Cloud
Snowflake
Apache Spark
Information Technology
Data Management
Data Pipelines
Databricks
Job description
We are looking for a skilled Big Data Engineer to join our growing technology team. The ideal candidate will have a strong background in Python, SQL, and data engineering, with experience processing large datasets and developing reliable data pipelines., * Develop and maintain data pipelines using Python and SQL.
- Collect, process, clean, and transform large datasets from different sources.
- Write, optimize, and maintain SQL queries for data extraction and transformation.
- Support ETL processes and data integration workflows.
- Monitor data quality and troubleshoot data-processing issues.
- Work with databases and data warehouses to support business requirements.
- Collaborate with developers, analysts, and other engineering teams to deliver data solutions.
- Identify opportunities to improve data pipeline performance and processing efficiency.
Requirements
- 2-5 years of professional experience in Big Data, Data Engineering, or a related field.
- Strong hands-on experience with Python and SQL.
- Experience working with large datasets and data-processing workflows.
- Understanding of ETL processes, data pipelines, and data transformation.
- Knowledge of databases and data warehousing concepts.
- Strong analytical, problem-solving, and debugging skills.
- Ability to work collaboratively and communicate effectively with technical teams.
Preferred Skills
- Familiarity with Big Data technologies such as Apache Spark, Hadoop, or Hive.
- Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Exposure to Snowflake, Databricks, or similar data platforms.
- Familiarity with NoSQL databases and distributed data processing., * Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
About the company
Information Tech Consultants Ltd (ITC) is a UK-based IT consultancy working with global clients, including Fortune 500 and FTSE 100 companies, delivering innovative software and enterprise technology solutions.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…