Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+23 more
Job description
*Design, develop, and maintain data pipelines leveraging Python, Spark/PySpark, and cloud-native services. *Build and optimize data workflows, ETL processes, and transformations for large-scale structured and semi-structured datasets. *Write advanced and efficient SQL queries against Snowflake, including joins, window functions, and performance tuning. *Develop backend and automation tools using Golang and/or Python as needed. *Implement scalable, secure, and high-quality data solutions across AWS servies such as S3, Lambda, Glue, Step Functions, EMR, and CloudWatch. *Troubleshoot complex production data issues, including pipeline failures, data quality gaps, and cloud environment challenges. *Perform root-cause analysis and implement automation to prevent recurring issues. *Collaborate with data scientists, analysts, platform engineers, and product teams to enable reliable, high-quality data access. *Ensure compliance with enterprise governance, data quality, and cloud security standards. *Participate in Agile ceremonies, code reviews, and DevOps practices to ensure high engineering quality.
Requirements
*Skills-Data Engineer- Python , Spark/PySpark, AWS, Golang, Able to write complex SQL queries against Snowflake tables / Troubleshoot issues, Java/Python, AWS (Glue, EC2, Lambda). *Proficiency in Python with experience building scalable data pipelines or ETL processes. *Strong hands-on experience with Spark/PySpark for distributed data processing. *Experience writing complex SQL queries (Snowflake preferred), including optimization and performance tuning. *Working knowledge of AWS cloud services used in data engineering (S3, Glue, Lambda, EMR, Step Functions, CloudWatch, IAM). *Experience with Golang for scripting, backend services, or performance-critical processes. *Strong debugging, troubleshooting, and analytical skills across cloud and data ecosystems. *Familiarity with CI/CD workflows, Git, and automated testing.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on leoforce.usGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know
Software Engineer Salary London