Big Data Engineer
Peoplentech Llc
7 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Tech stack
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Cloud Computing
Computer Programming
Data Transformation
Data Warehousing
Identity and Access Management
Python
Performance Tuning
Query Optimization
SQL Databases
Sql Optimization
Snowflake
Spark
AWS Lambda
Amazon Web Services (AWS)
Kafka
Cloudwatch
Stream Processing
Serverless Computing
Requirements
AWS Glue: Proficiency in developing and managing Spark-based Glue jobs.
Snowflake: Strong experience in Snowflake data warehousing, including schema design, query optimization, and performance tuning.
Kafka: Hands-on experience with Kafka for real-time data streaming and integration.
AWS Lambda: Experience in building serverless functions for event-driven workflows.
Programming: Proficiency in Python - SQL: Advanced SQL skills for data transformation and analysis.
Cloud Infrastructure: Familiarity with AWS services such as S3, CloudWatch, SES and IAM.
