Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+33 more
Job description
We are seeking a skilled and detail-oriented Data Engineer with approximately 3 years of experience to join our dynamic team. The ideal candidate will have a strong understanding of data engineering principles, data architecture, ETL processes, and cloud-based data platforms. You will play a key role in designing, developing, and maintaining scalable data pipelines and ensuring the availability, reliability, and integrity of data to support business intelligence, analytics, and operational needs., * Design, develop, and maintain scalable and efficient ETL/ELT data pipelines for ingesting, transforming, and loading data from multiple sources.
- Build and optimize data architectures, databases, and data warehouses to support reporting, analytics, and business intelligence initiatives.
- Develop and maintain data integration solutions using SQL, Python, and other relevant programming languages.
- Collaborate with business stakeholders, data analysts, data scientists, and software development teams to understand data requirements and deliver appropriate solutions.
- Monitor, troubleshoot, and optimize data pipelines to ensure high performance, reliability, and data quality.
- Implement data validation, cleansing, and governance processes to ensure data accuracy, consistency, and compliance.
- Develop and maintain data models, metadata, and documentation for data assets and workflows.
- Support the implementation of cloud-based data platforms and modern data engineering technologies.
- Ensure compliance with data security, privacy, and regulatory requirements.
- Participate in code reviews, testing, deployment, and continuous improvement of data engineering processes.
- Monitor system performance and resolve data-related issues in a timely manner.
- Stay up to date with emerging technologies and industry best practices in data engineering and recommend improvements where appropriate.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
- Approximately 3 years of experience as a Data Engineer or in a similar data-focused technical role.
- Strong proficiency in SQL and experience with relational and NoSQL databases.
- Experience developing ETL/ELT pipelines using industry-standard tools and frameworks.
- Proficiency in Python, Scala, Java, or another programming language used for data engineering.
- Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
- Familiarity with data warehousing concepts and modern data architectures.
- Experience with version control systems such as Git.
- Knowledge of Agile/Scrum software development methodologies.
- Strong analytical, problem-solving, and communication skills.
- Ability to manage multiple priorities in a fast-paced environment.
Preferred Skills (Optional)
- Experience with Apache Spark, Hadoop, Kafka, Airflow, Databricks, Snowflake, or similar big data technologies.
- Experience with cloud data services such as AWS Redshift, Azure Synapse Analytics, Azure Data Factory, Google BigQuery, or Amazon S3.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with data governance, data quality, and master data management.
- Relevant certifications such as AWS Certified Data Engineer, Microsoft Azure Data Engineer Associate, Google Professional Data Engineer, or Databricks Certified Data Engineer.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Software Engineer Salary London
Data Analyst Salary in the UK
The Most Popular IT Jobs on the Market
Top-Paying Tech Jobs (with Salaries)