Data Engineer - INTL India

Insight Global
Seattle, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Seattle, United States of America

Tech stack

Java
Airflow
Azure
Big Data
Computer Programming
Information Engineering
Data Governance
Data Integrity
ETL
Data Transformation
Data Warehousing
DevOps
Hadoop
Python
Performance Tuning
SQL Databases
Data Streaming
Unstructured Data
Workflow Management Systems
Data Processing
Azure
Snowflake
Spark
Data Lake
Kafka
Spark Streaming
Data Management
Machine Learning Operations
Stream Processing
Azure
Data Pipelines
Databricks

Job description

The ideal candidate will have extensive experience in data warehouse concepts, streaming data processing, Azure cloud services, Snowflake, and SQL. This role will be responsible for designing, building, and optimizing data pipelines, ensuring efficient data management and accessibility to support business intelligence and analytics.

Design, develop, and maintain data pipelines and ETL processes for structured and unstructured data.

  • Implement and optimize data warehouse solutions using Snowflake and Azure technologies.
  • Work with real-time data streaming technologies such as Apache Kafka, Azure Event Hubs, or similar.
  • Develop and optimize SQL queries for data transformation, aggregation, and analysis.
  • Ensure data integrity, security, and governance by implementing best practices.
  • Collaborate with cross-functional teams to understand data needs and deliver efficient solutions.
  • Monitor, troubleshoot, and improve performance of existing data pipelines and systems.
  • Stay up to date with industry trends and emerging technologies in data engineering.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

  • 3-5 years of experience in data engineering or a related field.
  • Strong expertise in SQL, data modeling, and data warehouse concepts.
  • Hands-on experience with Azure Data Services (Azure Data Factory, Azure Synapse, Azure Databricks, etc.).
  • Proficiency in Snowflake and its ecosystem, including performance tuning and optimization.
  • Experience with data streaming technologies such as Apache Kafka, Spark Streaming, or Azure Event Hubs.
  • Strong programming skills in Python, Scala, or Java for data processing.
  • Knowledge of data governance, security, and compliance best practices.
  • Ability to work in agile environments and collaborate effectively with cross-functional teams. - Experience with orchestration tools like Apache Airflow or Azure Data Factory.
  • Familiarity with CI/CD pipelines and DevOps practices in data engineering.
  • Knowledge of machine learning pipelines and MLOps is a plus.
  • Experience working with Big Data technologies such as Hadoop, Spark, or Delta Lake.

Apply for this position