Data Engineer (AWS, Snowflake, PySpark, SQL) at Onsite ( Full Time )

Siri InfoSolutions Inc
Auburn Hills, MI, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon S3 Big Data Cloud Database Code Review Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Warehousing Revision Control Systems Performance Tuning Scrum Methodology
+14 more
Query Optimization Cloud Services SQL Databases Data Logging Data Processing Data Ingestion Sql Optimization Snowflake Apache Spark Git Data Lakes Pyspark Optimization Algorithms Data Pipelines

Job description

  • Design, develop, and maintain scalable ETL/ELT data pipelines.
  • Build and optimize data processing solutions using PySpark and Snowflake.
  • Develop cloud-native data solutions leveraging AWS services.
  • Create and maintain data models for analytics and reporting requirements.
  • Perform data ingestion from multiple structured and unstructured data sources.
  • Optimize SQL queries, data pipelines, and Snowflake performance.
  • Ensure data quality, governance, security, and compliance standards.
  • Collaborate with Data Architects, Business Analysts, and Data Scientists.
  • Troubleshoot production issues and provide ongoing support.
  • Implement monitoring, logging, and performance tuning strategies.
  • Participate in code reviews and follow engineering best practices.
  • Document technical solutions, processes, and workflows.

Requirements

We are seeking an experienced Data Engineer with strong expertise in AWS, Snowflake, PySpark, and SQL to design, develop, and optimize scalable data pipelines and cloud-based data solutions. The ideal candidate will have hands-on experience building modern data platforms, processing large datasets, and supporting analytics and reporting requirements. Must Have Technical/Functional Skills

  • 5+ years of experience in Data Engineering.
  • Strong hands-on experience with AWS Cloud Services (S3, Glue, Lambda, EMR, Redshift, etc.).
  • Expertise in Snowflake Data Warehouse development and administration.
  • Strong experience in PySpark/Spark for large-scale data processing.
  • Advanced SQL skills with query optimization and performance tuning.
  • Experience in building and maintaining ETL/ELT pipelines.
  • Strong understanding of Data Warehousing and Data Lake concepts.
  • Experience with data modeling, partitioning, and optimization techniques.
  • Knowledge of version control tools such as Git.
  • Experience working in Agile/Scrum environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all