Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+26 more
Job description
Join our dynamic team as a Data Engineer and become a vital driver of our data-driven decision-making process! In this role, you will design, develop, and maintain robust data pipelines and architectures that empower our organization to harness the full potential of big data. You’ll work with cutting-edge technologies and collaborate across teams to deliver scalable, efficient, and innovative data solutions. Your expertise will enable us to turn complex data into actionable insights, fueling strategic growth and operational excellence., * Develop, implement, and optimize ETL (Extract, Transform, Load) processes to ensure seamless data flow across various platforms using tools like Talend, Informatica, and Shell Scripting.
- Design and maintain scalable data warehouses and data lakes utilizing AWS, Azure Data Lake, Hadoop, Apache Hive, Spark, and related big data technologies.
- Build and manage databases with Microsoft SQL Server, Oracle, and other relational systems; ensure high performance and security standards.
- Collaborate with cross-functional teams to gather requirements, analyze data needs, and translate them into technical solutions using SQL, Python, Java, and Bash scripting.
- Integrate linked data sources through RESTful APIs for comprehensive analytics capabilities.
- Support model training initiatives by preparing large datasets for machine learning applications.
- Conduct analysis to identify trends or issues within datasets; communicate findings effectively using Looker or other visualization tools.
- Maintain documentation of data architecture designs, workflows, and procedures following Agile methodologies for continuous improvement.
Requirements
Do you have experience in Data-driven problem-solving?, * Proven experience in designing and implementing large-scale data pipelines using AWS services such as S3, Glue, or Redshift.
- Strong proficiency in programming languages including Java and Python for data processing tasks.
- Extensive knowledge of big data frameworks like Hadoop ecosystem (HDFS, Hive) and Spark for distributed processing.
- Hands-on experience with SQL Server, Oracle databases, and Data Warehouse concepts to support enterprise analytics initiatives.
- Familiarity with ETL tools such as Talend or Informatica for efficient data integration workflows.
- Experience working with cloud platforms like Azure Data Lake or similar environments is highly desirable.
- Solid understanding of database design principles combined with analysis skills to interpret complex datasets effectively.
- Knowledge of shell scripting (Bash), Unix/Linux environments, RESTful API integration, and VBA is a plus. Join us if you’re passionate about transforming raw data into powerful insights! We’re committed to fostering an innovative environment where your technical expertise makes a real impact on our organization’s success.
Benefits & conditions
- Dental insurance
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
The Most Popular IT Jobs on the Market