WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Big Data Engineer

Cyma Systems Inc
Rockville, MD, United States
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
www.dice.com

Tech stack

Agile Methodology Artificial Intelligence Amazon S3 Automation of Tests Big Data Continuous Integration Perl (Programming Language) Github Apache Hadoop Apache Hive Python (Programming Language) Performance Tuning
+5 more
SQL Databases Prompt Engineering Apache Spark AWS Data Analytics GPT

Job description

Apache Spark Hadoop Ecosystem Scala & Hive Python or Perl Scripting Expert-level Complex SQL (Window Functions, Multi-Table Joins) AWS - S3, EMR, Glue, Athena GitHub & CI/CD Pipelines Agile Methodologies & Test Automation AI Tools - GitHub Copilot, ChatGPT, Amazon Q (Prompt Engineering) Preferred: Financial Services / Banking Domain Experience Key Responsibilities: Build and optimize enterprise-scale Big Data pipelines Performance tuning for Spark, Hadoop & SQL workloads Develop scalable AWS data solutions Implement CI/CD, automated testing & data quality validation Utilize AI-assisted development tools to improve engineering productivity

Requirements

5+ Years of Big Data Engineering Experience Strong expertise in Spark, Hadoop, Hive & Scala Hands-on AWS Data Services (S3, EMR, Glue, Athena) Advanced SQL optimization & performance tuning

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · WWC Europe 2026

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all
Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

Evaluating AI models for code comprehension thumbnail
22:03
WWC 2025 • 12 months ago

Evaluating AI models for code comprehension

Merrill Lutsky

Innovating Developer Tools with AI: Insights from GitHub Next thumbnail
42:38
LIVE • over 1 year ago

Innovating Developer Tools with AI: Insights from GitHub Next

Krzystof Czieslak

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
WWC Europe 2026 • about 1 month ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands thumbnail
28:37
WWC 2024 • almost 2 years ago

Speak, Code, Deploy: Transforming Developer Experience with Voice Commands

Sami Ekblad

Related articles

See all