Data Engineer III

Dexian DISYS
Charlotte, NC, United States
14 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Amazon Web Services Data Analysis Batch Processing Business Intelligence Development Code Review Data as a Services Information Engineering Data Governance Persistent Data Structure Data Systems Data Warehousing
+25 more
Relational Databases Database Queries Dimensional Modeling Distributed Data Store Distributed Systems Fault Tolerance Python (Programming Language) PostgreSQL Meta-Data Management Data Streaming Data Logging Data Processing Data Ingestion AWS Lambda Event Driven Architecture Data Lakes Pyspark Low Latency Apache Flink AWS Glue Qlikview Apache Kafka Stream Processing Data Pipelines Amazon Redshift

Job description

We are seeking a Senior Data Engineer to design, build, and maintain scalable data engineering solutions that power analytics, reporting, and data products across the organization. This role works closely with product managers, data analysts, BI developers, and other engineers to deliver reliable, high quality data pipelines across both batch and real time streaming architectures. The ideal candidate has deep experience building cloud native data solutions on AWS, strong fundamentals in distributed systems, and hands on experience with stream processing frameworks such as Apache Flink, using Python and Java., * Design, develop, and maintain scalable data pipelines supporting batch and real time streaming workloads

  • Build and optimize data processing jobs using AWS Glue, PySpark, Python, and Java
  • Develop and maintain stream processing applications using Apache Flink
  • Implement reliable data ingestion solutions using AWS DMS, Kafka, and AWS Lambda
  • Design and manage data persistence layers using Amazon Aurora (PostgreSQL) and related AWS services Streaming & Batch Processing

  • Design and support real time and near real time streaming pipelines using Kafka and Apache Flink
  • Build and maintain stateful stream processing jobs, including windowing, aggregation, and event time processing
  • Develop efficient batch processing workflows for large scale data transformation and enrichment
  • Ensure data consistency, latency, fault tolerance, and reliability across streaming and batch systems Data Quality, Reliability & Performance

  • Implement monitoring, logging, and alerting for batch and streaming data pipelines
  • Diagnose and resolve data quality, performance, and scalability issues
  • Apply best practices for schema evolution, checkpointing, fault tolerance, and back pressure handling
  • Optimize pipelines for performance and cost efficiency Analytics & Consumption

  • Enable downstream analytics and reporting through well modeled, well documented datasets
  • Partner with analytics and BI teams supporting tools such as Qlik
  • Support data consumers by improving data discoverability, usability, and trust Collaboration & Engineering Excellence

  • Collaborate with product, analytics, and platform teams to translate requirements into technical solutions
  • Participate in architecture discussions, design reviews, and code reviews
  • Contribute to data engineering standards, reusable frameworks, and documentation
  • Mentor junior engineers and promote best practices across the team ______________ Core Technologies This role will work extensively with the following technologies:

  • AWS Glue
  • PySpark
  • Python
  • Java
  • Apache Flink (Stream Processing)
  • Kafka
  • AWS DMS
  • AWS Lambda
  • Amazon Aurora (PostgreSQL)
  • Streaming and Batch Data Processing
  • Qlik (analytics / BI consumption)

Requirements

  • Amazon Redshift
  • Data warehousing concepts (dimensional modeling, star/snowflake schemas)
  • Experience building or supporting enterprise data warehouses or data lakes
  • Familiarity with event driven architectures and real time analytics use cases
  • Experience with data governance, metadata management, or lineage tools, * 5+ years of experience in data engineering or backend engineering
  • Strong hands on experience with Python and Java in distributed systems
  • Experience building streaming data applications using Apache Flink and Kafka
  • Solid experience with AWS data services
  • Strong SQL skills and understanding of relational data modeling
  • Experience working with large scale, distributed data systems

About the company

Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

55 sec

Validating data processing architectures via containerized events

Modood Alvi · World Congress 2025

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

47 sec

Building modern data pipelines for legacy exports

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

1:29 min

Utilizing specific tooling for continuous integration and modeling

Christoph Fassbach Christoph Fassbach +1 · World Congress 2024

Videos

See all

Related articles

See all