Senior Data Engineer

Cox powered by Atrium
New York, NY, United States
7 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$145,000.0 - $160,000.0
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Data Analysis Big Data Cloud Computing Code Review Data as a Services Data Architecture Data Validation Information Engineering
+26 more
Data Governance Data Integrity Extract Transform Load (ETL) Data Systems Database Queries Software Design Patterns Dimensional Modeling Amazon DynamoDB Python (Programming Language) Meta-Data Management Scrum Methodology Redis Cloud Services Software Engineering Unstructured Data Enterprise Data Management Sql Optimization Electronic Medical Records AWS Lambda Git Information Technology Data Lineage AWS Glue Data Pipelines Amazon Elastic Mapreduce (EMR) Amazon Redshift

Job description

The Senior Data Engineer will join the technology team to design, develop, and continuously enhance enterprise data platforms, business applications, and integration solutions. This hands-on Senior Data Engineer role will be responsible for building scalable data architectures, developing reliable data pipelines, and supporting analytics initiatives through modern cloud technologies. The ideal Senior Data Engineer candidate will have extensive experience designing enterprise data warehouses, developing AWS-based data solutions, optimizing data workflows, and implementing data quality and governance practices. This position requires a highly technical engineer who can collaborate with cross-functional teams while driving best practices around scalability, automation, and data reliability., * Design, implement, and maintain scalable data architectures, pipelines, and modeling strategies supporting enterprise data platforms.

  • Build and manage data models and schemas within cloud-based data warehouses to enable self-service analytics.
  • Develop, monitor, optimize, and troubleshoot data pipelines to ensure reliability, performance, and availability.
  • Implement data quality checks, validation processes, and monitoring solutions to maintain trusted datasets.
  • Utilize AWS services including Glue, Lambda, S3, Athena, EMR, EC2, and DynamoDB to build scalable data solutions.
  • Partner with Data Science, Analytics, and Business teams to understand requirements and deliver reliable data products.
  • Improve data lineage, documentation, cataloging, and governance practices across enterprise data assets.
  • Create and maintain technical documentation, SOPs, and version-controlled workflows using tools such as Git and dbt.
  • Participate in Agile ceremonies including sprint planning, code reviews, and retrospectives.
  • Promote reusable architecture patterns, automation, and modern data engineering practices.
  • Mentor team members and contribute to continuous improvement initiatives.
  • Stay current with emerging data technologies and identify opportunities for innovation.

Requirements

  • 6+ years of experience in software engineering, data engineering, or related technology roles.
  • Proven experience working as a Senior Data Engineer building and maintaining robust enterprise data systems.
  • Strong expertise designing and implementing enterprise data warehouses, including star schemas and dimensional modeling techniques.
  • Advanced SQL skills with experience writing complex queries, optimizing performance, and working with large datasets.
  • Hands-on experience with AWS data services, including Amazon Redshift, Amazon S3, AWS Glue, Amazon Athena, Amazon EMR, Amazon EC2, AWS Lambda, and DynamoDB.
  • Experience building scalable ETL/ELT pipelines and modern data workflows.
  • Knowledge of structured, semi-structured, and unstructured data environments.
  • Experience implementing data governance, quality assurance, and observability practices.
  • Strong ownership mindset with the ability to drive solutions from design through deployment.
  • Ability to communicate technical concepts effectively with engineering, analytics, and business stakeholders.

Preferred Experience/Skills for the Senior Data Engineer:

  • Python programming experience.
  • Experience with dbt Labs and modern analytics engineering practices.
  • Experience with Redis or similar caching technologies.
  • Familiarity with data cataloging, lineage, and metadata management solutions.
  • Prior leadership, mentoring, or technical ownership experience.
  • Experience working in Agile/Scrum environments.
  • Understanding of automation, reusable design patterns, and cloud-native data architectures.

Education Requirements:

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, Data Science, or a related field is preferred.
  • Equivalent professional experience will also be considered.

Benefits & conditions

Pulled from the full job description Opportunities for advancement, * Competitive salary and comprehensive benefits package.

  • Complimentary membership and access to company services.
  • Employee perks and incentives across products and services.
  • Opportunities for professional growth and career advancement.
  • Collaborative, innovative, and high-performance work environment.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

55 sec

Validating data processing architectures via containerized events

Modood Alvi · WWC 2025

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:42 min

Comparing in-memory and Redis storage for cache scalability

Simone Sanfratello · WWC 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all