Data Engineer
Techno Talent Inc.
Rockville, United States of America
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Rockville, United States of America
Tech stack
Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Continuous Integration
Information Engineering
Database Queries
Github
Hadoop
Hive
Python
Octopus Deploy
Performance Tuning
Prometheus
Sql Optimization
GitHub Copilot
Grafana
Spark
Gitlab
Kubernetes
Terraform
GPT
Docker
Jenkins
Job description
We are seeking experienced Data Engineers with strong expertise in Apache Spark, AWS, Kubernetes/EKS, and Big Data platforms.
Requirements
- 5+ years of Data Engineering experience
- Strong hands-on experience with Apache Spark
- Experience with Amazon EKS / EMR on EKS
- Big Data technologies: Hadoop, Hive, Trino
- Strong Python or Scala development skills
- Advanced SQL (window functions, joins, complex queries)
- Kubernetes administration and troubleshooting
- AWS services: S3, EMR, Glue, Athena, Lambda
- Experience processing large-scale datasets and tuning Spark jobs
- Familiarity with AI tools such as GitHub Copilot, ChatGPT, Claude, or Amazon Q
Preferred Skills:
- CI/CD (GitLab, Jenkins, GitHub Actions, ArgoCD)
- Terraform / Infrastructure as Code
- Docker, Prometheus, Grafana
- Spark on Kubernetes
- Financial Services experience