Data Engineer

Job Cloud Inc.
United States
7 days ago

Role details

Contract type
Internship / Graduate position
Employment type
Full-time (> 32 hours)
Compensation
$100,000.0 - $150,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Agile Methodology Amazon Web Services Business Analytics Applications Microsoft Azure Bash Shell Big Data Cloud Computing Cloud Database Code Review Computer Programming Databases
+28 more
Information Engineering Extract Transform Load (ETL) Data Systems Data Warehousing Dimensional Modeling Electronic Data Interchange (EDI) Apache Hadoop Apache Hive Python (Programming Language) Linked Data Unix Shell Microsoft SQL Server Oracle (Applications) Scrum Methodology Azure Data Lake Shell Script Software Engineering SQL Databases Data Streaming Talend Data Storage Management Informatica Powercenter Apache Spark Vba Programming Language Data Management Restful APIs Looker Analytics Data Pipelines

Job description

We are seeking a dynamic and innovative Data Engineer to join our team and drive the development of robust data systems that empower insightful decision-making. In this role, you will design, build, and maintain scalable data pipelines and architectures that support large-scale data processing and analytics. Your expertise will enable the organization to harness the full potential of its data assets, ensuring seamless integration across diverse platforms and tools. If you thrive in a fast-paced environment where cutting-edge technology meets business needs, this is your opportunity to make a significant impact., * Develop, implement, and optimize ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow from various sources into data warehouses and lakes.

  • Design and maintain scalable data models and schemas using dimensional modeling techniques for business intelligence and analytics purposes.
  • Manage big data systems utilizing Hadoop, Spark, Apache Hive, and cloud-based solutions such as Azure Data Lake and AWS.
  • Collaborate with cross-functional teams to integrate linked data sources and ensure data quality, consistency, and security across platforms.
  • Build and enhance data management integration processes using tools like Informatica, Talend, and RESTful APIs for seamless data exchange.
  • Support the development of analytics solutions by working with SQL databases like Microsoft SQL Server, Oracle, and cloud databases to enable advanced query management.
  • Contribute to agile development cycles by participating in sprint planning, code reviews, and continuous improvement initiatives for data engineering workflows.

Requirements

  • Proven experience designing and implementing large-scale big data systems with technologies such as Hadoop, Spark, Apache Hive, or similar frameworks.
  • Strong proficiency in SQL programming with experience in SQL databases including Microsoft SQL Server, Oracle, or cloud-based options like Azure Data Lake or other cloud databases.
  • Hands-on expertise in software development using Java, Python, Bash (Unix shell), Shell Scripting, or VBA for automation and pipeline development.
  • Familiarity with cloud platforms such as AWS or Azure Public Cloud environments for deploying scalable data solutions.
  • Knowledge of data warehousing design principles including dimensional modeling and ETL pipeline development for efficient data storage and retrieval.
  • Experience working with business intelligence tools like Looker or similar platforms for creating dashboards and visualizations.
  • Excellent analysis skills with the ability to interpret complex datasets and support model training initiatives.
  • Strong understanding of data management integration practices including RESTful API development and linked data concepts.
  • Ability to work effectively within an Agile environment while managing multiple priorities simultaneously.

Join us to leverage your expertise in big data systems, cloud technologies, and software development-helping us transform raw information into strategic insights that drive our success!

Benefits & conditions

Pulled from the full job description

  • 401(k), * 401(k)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · WWC Europe 2026

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · WWC 2022

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all