Data Engineer
Role details
Job location
Tech stack
Job description
- Design, develop, and maintain robust ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow from diverse sources such as cloud databases, SQL servers, and big data systems.
- Build and optimize data models using dimensional modeling techniques to support enterprise data warehousing and analytics initiatives.
- Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions utilizing tools like Informatica, Talend, Apache Hive, Spark, and Hadoop.
- Manage large-scale data storage solutions in cloud environments such as Azure Data Lake and AWS Public Cloud, ensuring high availability and security.
- Develop and implement data management strategies that incorporate linked data principles for enhanced interoperability across datasets.
- Write complex SQL queries using Microsoft SQL Server, Oracle, or other SQL databases to extract insights and support reporting needs.
- Support business intelligence tools like Looker by creating dashboards and reports that provide meaningful insights for stakeholders.
- Contribute to agile development cycles by participating in sprint planning, code reviews, and continuous improvement efforts related to data engineering processes.
- Automate routine tasks through shell scripting (Bash/Unix shell), Python programming, or VBA to improve efficiency.
- Assist in model training and analysis activities by preparing datasets that enable machine learning initiatives.
Requirements
We are seeking a dynamic and innovative Data Engineer to join our team and drive the development of scalable, high-performance data solutions. In this role, you will harness the power of cloud platforms, big data systems, and advanced data modeling techniques to enable insightful analytics and business intelligence. Your expertise will help shape our data architecture, optimize data pipelines, and support strategic decision-making across the organization. If you are passionate about transforming complex data into actionable insights and thrive in a fast-paced environment, this opportunity is for you!, * Proven experience in software development with a focus on data engineering or related fields.
- Strong proficiency in SQL programming with experience in SQL databases such as Microsoft SQL Server or Oracle.
- Hands-on experience with big data technologies including Hadoop, Spark, Apache Hive, and cloud-based platforms like Azure Data Lake or AWS Public Cloud.
- Familiarity with ETL tools such as Informatica or Talend for data integration workflows.
- Knowledge of cloud databases and data warehousing design principles including dimensional modeling and query management techniques.
- Experience developing ETL pipelines using Python or Shell Scripting for automation purposes.
- Understanding of business intelligence tools such as Looker for creating dashboards and reports.
- Ability to design scalable data models that support analytics and reporting needs across diverse datasets.
- Strong analysis skills with the ability to interpret complex datasets and communicate findings effectively.
- Familiarity with RESTful APIs for integrating external systems into the data ecosystem is a plus.
- Experience working within an Agile environment to deliver iterative improvements efficiently.
Join us if you're eager to leverage your technical expertise in a collaborative setting that values innovation and continuous learning!
Benefits & conditions
Pulled from the full job description
- Referral program
- Professional development assistance
- Health insurance
- Paid time off
- Flexible schedule, * Flexible schedule
- Health insurance
- Paid time off
- Professional development assistance
- Referral program