Data Engineer

Raas Infotek LLC
Carolina Beach, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Carolina Beach, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Azure
Big Data
Google BigQuery
Cloud Computing
Cloud Database
Continuous Integration
Data Architecture
Information Engineering
Data Governance
ETL
Data Mart
Data Systems
Data Warehousing
DevOps
Python
Performance Tuning
SQL Databases
Data Streaming
Google Cloud Platform
Data Storage Technologies
Snowflake
Spark
PySpark
Infrastructure Automation Frameworks
Information Technology
Kafka
Data Management
Terraform
Data Pipelines

Job description

  • Design and implement scalable, high-performance data pipelines and ETL/ELT processes.
  • Develop and maintain enterprise data lakes, data warehouses, and data marts.
  • Lead data architecture initiatives and establish best practices for data engineering.
  • Optimize data storage, processing, and retrieval for large-scale datasets.
  • Collaborate with Data Scientists, Business Analysts, and stakeholders to deliver data solutions.
  • Ensure data quality, governance, security, and compliance standards are met.
  • Mentor junior engineers and provide technical leadership to the data engineering team.
  • Drive cloud migration and modernization initiatives.

Requirements

We are looking for a highly experienced Senior Data Engineer to lead the design, development, and optimization of enterprise-scale data platforms and pipelines. The ideal candidate will have extensive experience in cloud-based data solutions, data warehousing, big data technologies, and data architecture., * 10+ years of experience in Data Engineering or related roles.

  • Strong expertise in Python, SQL, and PySpark.

  • Hands-on experience with Apache Spark, Kafka, and data streaming technologies.

  • Experience with cloud platforms: AWS, Azure, or Google Cloud Platform.

  • Strong knowledge of data warehousing solutions such as Snowflake, Redshift, or BigQuery.

  • Experience with ETL/ELT tools such as Airflow, Informatica, or dbt.

  • Deep understanding of data modeling, performance tuning, and data governance.

  • Experience with CI/CD, DevOps practices, and Infrastructure as Code (Terraform).

  • Bachelor''''s or Master''''s degree in Computer Science, Engineering, or related field.

  • Cloud certifications (AWS, Azure, or Google Cloud Platform) preferred.

  • Experience leading data engineering teams and large-scale data projects.

Apply for this position