Data Engineer

Job Cloud Inc.
yesterday

Role details

Contract type
Internship / Graduate position
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 150K

Job location

Remote

Tech stack

Java
Agile Methodologies
Amazon Web Services (AWS)
Business Analytics Applications
Azure
Bash
Big Data
Cloud Computing
Cloud Database
Code Review
Computer Programming
Databases
Information Engineering
ETL
Data Systems
Data Warehousing
Dimensional Modeling
Electronic Data Interchange (EDI)
Hadoop
Hive
Python
Linked Data
Shell
Microsoft SQL Server
Oracle Applications
Scrum
Azure
Shell Script
Software Engineering
SQL Databases
Data Streaming
Talend
Data Storage Management
Informatica Powercenter
Spark
Vba Programming Language
Data Management
REST
Looker Analytics
Data Pipelines

Job description

We are seeking a dynamic and innovative Data Engineer to join our team and drive the development of robust data systems that empower insightful decision-making. In this role, you will design, build, and maintain scalable data pipelines and architectures that support large-scale data processing and analytics. Your expertise will enable the organization to harness the full potential of its data assets, ensuring seamless integration across diverse platforms and tools. If you thrive in a fast-paced environment where cutting-edge technology meets business needs, this is your opportunity to make a significant impact., * Develop, implement, and optimize ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow from various sources into data warehouses and lakes.

  • Design and maintain scalable data models and schemas using dimensional modeling techniques for business intelligence and analytics purposes.
  • Manage big data systems utilizing Hadoop, Spark, Apache Hive, and cloud-based solutions such as Azure Data Lake and AWS.
  • Collaborate with cross-functional teams to integrate linked data sources and ensure data quality, consistency, and security across platforms.
  • Build and enhance data management integration processes using tools like Informatica, Talend, and RESTful APIs for seamless data exchange.
  • Support the development of analytics solutions by working with SQL databases like Microsoft SQL Server, Oracle, and cloud databases to enable advanced query management.
  • Contribute to agile development cycles by participating in sprint planning, code reviews, and continuous improvement initiatives for data engineering workflows.

Requirements

  • Proven experience designing and implementing large-scale big data systems with technologies such as Hadoop, Spark, Apache Hive, or similar frameworks.
  • Strong proficiency in SQL programming with experience in SQL databases including Microsoft SQL Server, Oracle, or cloud-based options like Azure Data Lake or other cloud databases.
  • Hands-on expertise in software development using Java, Python, Bash (Unix shell), Shell Scripting, or VBA for automation and pipeline development.
  • Familiarity with cloud platforms such as AWS or Azure Public Cloud environments for deploying scalable data solutions.
  • Knowledge of data warehousing design principles including dimensional modeling and ETL pipeline development for efficient data storage and retrieval.
  • Experience working with business intelligence tools like Looker or similar platforms for creating dashboards and visualizations.
  • Excellent analysis skills with the ability to interpret complex datasets and support model training initiatives.
  • Strong understanding of data management integration practices including RESTful API development and linked data concepts.
  • Ability to work effectively within an Agile environment while managing multiple priorities simultaneously.

Join us to leverage your expertise in big data systems, cloud technologies, and software development-helping us transform raw information into strategic insights that drive our success!

Benefits & conditions

Pulled from the full job description

  • 401(k), * 401(k)

Apply for this position