Senior Big Data Developer

Ecco
Alexandria, VA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$135,200.0 - $156,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) JavaScript (Programming Language) Airflow Amazon Web Services Business Analytics Applications Data Analysis Microsoft Azure Big Data Cloud Computing Computer Programming Databases Continuous Integration
+45 more
Data Architecture Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Systems Data Warehousing Database Applications Relational Databases Database Design Distributed Systems Perl (Programming Language) Github Graph Database Python (Programming Language) PostgreSQL Linux System Administration Machine Learning Microsoft SQL Server MySQL NoSQL Performance Tuning Cloud Services DataOps Scala (Programming Language) Software Engineering SQL Databases Systems Integration Unstructured Data Workflow Management Systems Enterprise Data Management Data Processing Scripting Cloud Platform System Snowflake Change Data Capture Gitlab Data Lakes Information Technology Integration Frameworks Data Management Data Delivery Software Version Control Data Pipelines Programming Languages

Job description

We are seeking an experienced Senior Big Data Developer to design, develop, and optimize enterprise data platforms, data pipelines, and analytics solutions. This individual will play a key role in expanding and enhancing data architecture capabilities, enabling efficient ingestion, organization, processing, and visualization of large-scale data assets. The ideal candidate combines strong data engineering expertise with hands-on experience in database design, data modeling, cloud technologies, and scalable data processing frameworks., * Design, develop, and maintain enterprise data architectures, databases, data lakes, and scalable data platforms.

  • Build, optimize, and automate ETL/ELT workflows and data integration pipelines.
  • Develop and maintain scalable data processing frameworks capable of handling high-volume structured and unstructured data.
  • Collaborate with business stakeholders, analysts, researchers, and technical teams to understand data requirements and deliver effective solutions.
  • Improve existing data systems and recommend enhancements to increase performance, reliability, and scalability.
  • Design and implement optimal data delivery architectures to support analytics, reporting, forecasting, and operational needs.
  • Perform root cause analysis on data issues and business processes to identify opportunities for improvement.
  • Support migration of data pipelines and workflows between on-premises and cloud environments.
  • Implement data governance, quality, security, and operational best practices.
  • Contribute to software development lifecycle activities, including development, testing, deployment, and maintenance of data applications and services.
  • Design and communicate enterprise information architecture at conceptual, logical, and physical levels.

Requirements

Do you have experience in Version control?, * Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related technical field.

  • Minimum of 7 years of experience in data engineering, data architecture, database administration, or related disciplines.
  • Advanced proficiency in SQL and experience with relational database platforms such as PostgreSQL, Microsoft SQL Server, and MySQL.
  • Advanced programming experience with Python, R, and other scripting languages used for data engineering and analytics.
  • Experience working with large-scale data systems, distributed computing environments, and scalable data processing architectures.
  • Experience designing, developing, and automating ETL/ELT workflows and data integration solutions.
  • Experience building, optimizing, and maintaining scalable databases and data pipelines.
  • Strong software engineering background, including development, testing, and deployment of data-driven applications.
  • Experience working in Linux environments and utilizing source control platforms such as GitHub and GitLab.
  • Excellent analytical, troubleshooting, problem-solving, verbal communication, and written communication skills.
  • Strong customer-service orientation and ability to work independently in a collaborative environment., * Advanced degree in a technical discipline.
  • Experience with workflow orchestration and automation tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
  • Experience with cloud platforms including AWS, Microsoft Azure, and Snowflake.
  • Experience implementing data warehouses utilizing Change Data Capture (CDC) methodologies.
  • Experience implementing and maintaining CI/CD pipelines and DataOps practices.
  • Experience with NoSQL and graph database technologies.
  • Experience developing, training, deploying, and maintaining machine learning models.
  • Knowledge of time-series data management, analytics, and forecasting techniques.
  • Experience integrating structured and unstructured data sources.
  • Working knowledge of additional programming languages such as Java, Scala, JavaScript, or Perl.
  • Experience supporting analytics, research, financial, scientific, or data-intensive environments.

Core Competencies

  • Data Architecture & Modeling
  • Big Data Engineering
  • Cloud Data Platforms
  • ETL/ELT Development
  • Database Design & Administration
  • Data Integration & Automation
  • DataOps & CI/CD
  • Machine Learning Enablement
  • Enterprise Information Architecture
  • Performance Optimization & Troubleshooting
  • Cross-Functional Collaboration
  • Strategic Problem Solving

Benefits & conditions

3.73.7 out of 5 stars Alexandria, VA 22314 $65 - $75 an hour - Contract, Pulled from the full job description

  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Dental insurance, * 401(k) matching
  • Dental insurance
  • Health insurance
  • Paid time off
  • Vision insurance

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

Videos

See all

Related articles

See all