Big Data Engineer

Information Tech Consultants
UK
24 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
£35,000.0 - £45,000.0
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Big Data Cloud Computing Databases Information Engineering Data Integration Extract Transform Load (ETL) Data Transformation Data Mining Data Systems Data Warehousing
+15 more
Software Debugging Distributed Computing Environment Apache Hadoop Apache Hive Python (Programming Language) NoSQL SQL Databases Data Processing Google Cloud Snowflake Apache Spark Information Technology Data Management Data Pipelines Databricks

Job description

We are looking for a skilled Big Data Engineer to join our growing technology team. The ideal candidate will have a strong background in Python, SQL, and data engineering, with experience processing large datasets and developing reliable data pipelines., * Develop and maintain data pipelines using Python and SQL.

  • Collect, process, clean, and transform large datasets from different sources.
  • Write, optimize, and maintain SQL queries for data extraction and transformation.
  • Support ETL processes and data integration workflows.
  • Monitor data quality and troubleshoot data-processing issues.
  • Work with databases and data warehouses to support business requirements.
  • Collaborate with developers, analysts, and other engineering teams to deliver data solutions.
  • Identify opportunities to improve data pipeline performance and processing efficiency.

Requirements

  • 2-5 years of professional experience in Big Data, Data Engineering, or a related field.
  • Strong hands-on experience with Python and SQL.
  • Experience working with large datasets and data-processing workflows.
  • Understanding of ETL processes, data pipelines, and data transformation.
  • Knowledge of databases and data warehousing concepts.
  • Strong analytical, problem-solving, and debugging skills.
  • Ability to work collaboratively and communicate effectively with technical teams.

Preferred Skills

  • Familiarity with Big Data technologies such as Apache Spark, Hadoop, or Hive.
  • Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
  • Exposure to Snowflake, Databricks, or similar data platforms.
  • Familiarity with NoSQL databases and distributed data processing., * Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

About the company

Information Tech Consultants Ltd (ITC) is a UK-based IT consultancy working with global clients, including Fortune 500 and FTSE 100 companies, delivering innovative software and enterprise technology solutions.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…