WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Big Data Developer

Techno Talent Inc.
Rockville, MD, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source
dice.com

Tech stack

Amazon Web Services Amazon S3 Automation of Tests Big Data Computer Programming Information Engineering Extract Transform Load (ETL) Apache Hadoop Apache Hive Python (Programming Language) Operational Databases Performance Tuning
+9 more
Query Optimization SQL Databases Data Processing Sql Optimization GitHub Copilot Apache Spark Kubernetes GPT Data Pipelines

Job description

We are seeking an experienced Big Data Developer with strong expertise in Apache Spark, Hadoop, AWS, Python/Scala, and SQL to build and optimize large-scale data processing solutions.

Requirements

  • 8+ years of Big Data/Data Engineering experience
  • Strong hands-on experience with Apache Spark
  • Hadoop Ecosystem: Hadoop, Hive, Trino
  • Strong programming skills in Python or Scala
  • Advanced SQL (Joins, Window Functions, Aggregations, Query Optimization)
  • Experience building and supporting large-scale ETL/Data Pipelines
  • AWS Services: S3, EMR, Glue, Athena, Lambda
  • Experience troubleshooting Spark jobs, data skew, performance tuning, and large-volume data processing
  • Knowledge of Agile/Scrum development methodologies
  • Experience with AI-assisted development tools (GitHub Copilot, ChatGPT, Claude, Amazon Q)

Preferred Skills:

  • EKS / Kubernetes
  • CI/CD Pipelines
  • Test Automation
  • Production Data Pipeline Support
  • AWS Certifications
  • Financial Services Experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all
Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

WeAreDevelopers LIVE - CSS is DOOMed thumbnail
59:11
LIVE • 5 months ago

WeAreDevelopers LIVE - CSS is DOOMed

Chris Heilmann, Daniel Cranney, Justin Halsall, Christian Schaefer

Evaluating AI models for code comprehension thumbnail
22:03
WWC 2025 • 12 months ago

Evaluating AI models for code comprehension

Merrill Lutsky

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Hate organising your photos? Try it with 5 Terabytes thumbnail
30:25
LIVE • over 5 years ago

Hate organising your photos? Try it with 5 Terabytes

Arto Liukkonen

Streaming AI Responses in Real-Time with SSE in Next.js & NestJS thumbnail
29:54
WWC 2025 • 12 months ago

Streaming AI Responses in Real-Time with SSE in Next.js & NestJS

Ahmed Megahd

Related articles

See all