Data Engineers

OCI Partners LP

United States

3 months ago

Apply on builtincolorado.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

builtincolorado.com

Tech stack

Java (Programming Language) Agile Methodology Artificial Intelligence Amazon Web Services Microsoft Azure Big Data BigQuery Cloud Computing Information Engineering Data Governance Extract Transform Load (ETL) Data Systems

+27 more

Data Warehousing DevOps Distributed Systems Python (Programming Language) Microsoft SQL Server NoSQL Power BI Ansible SQL Databases Systems Integration Tableau (Software) Google Cloud Data Ingestion Snowflake Apache Spark Infrastructure as Code (IaC) Event Driven Architecture Data Lakes Information Technology Apache Kafka Tools for Reporting Restful APIs Terraform Stream Processing Data Pipelines Databricks Golang

Job description

Remote or Hybrid Mid level Remote or Hybrid Mid level Design, develop, and manage data infrastructure for internal and client projects, focusing on large-scale data pipelines, APIs, and cloud deployments. The summary above was generated by AI Object Computing, Inc. (OCI) OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team. About OCI We provide a collaborative environment focused on innovation, leveraging open-source software and strategic partnerships with Amazon and Google to build transformative technology solutions., * Design, build, and optimize large-scale data pipelines (Azure, AWS, GCP)

Develop data ingestion and storage solutions.
Implement scalable APIs and ensure system performance.
Manage big data infrastructure and cloud deployments.
Collaborate with developers, designers, and data scientists.
Work in an Agile/DevOps environment.

Requirements

ETL data engineering (Databricks, SQL Server, Snowflake, BigQuery, Apache Spark).
Proficiency in Go, Java, Python, or Scala.
Proficiency in CI/CD pipelines and Infrastructure as Code (IaC) (Terraform, CDK, Ansible).
Hands-on experience with event-driven architectures (Kafka, Pulsar).
Strong knowledge of data warehousing, SQL/NoSQL databases, and cloud platforms.
Experience with distributed computing, DevOps tools, and data governance.
Familiarity with Delta Lake, Unity Catalog, Delta Sharing, and DLT., * Degree in Computer Science, Data Engineering, or a related field, or equivalent experience.
Experience with AI/ML-driven data solutions and real-time data processing.
Expertise in building scalable APIs and integrating with modern analytics tools (Power BI, Tableau, QuickSight).
Cloud certifications (Databricks, AWS, Azure, GCP).