Senior Data Engineer

Bartech Staffing
McAdenville, NC, United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Amazon Elastic Compute Cloud Apache HTTP Server Audit Trail Cloud Computing Databases Data Governance Data Integrity Data Migration Data Security Relational Databases PostgreSQL Online Transaction Processing
+19 more
Oracle Databases Oracle (Applications) Standard Sql Software Engineering Data Streaming Real Time Systems Change Data Capture Cloudformation Amazon Relational Database Service Data Lakes Infrastructure Automation Frameworks Data Lineage Apache Flink Real Time Data Apache Kafka Data Lakehouse Hardware Infrastructure Terraform Data Pipelines

Job description

  • Database Architecture & Design: Design and implement PostgreSQL databases and schemas from the ground up, ensuring optimal performance, scalability, and maintainability
  • Legacy System Migration: Lead the migration of large-scale Oracle databases from on-premises infrastructure to AWS RDS PostgreSQL clusters, managing data integrity and minimizing downtime
  • Real-Time Data Products: Build and optimize data products leveraging Apache Kafka, Apache Flink, and Apache Hudi to deliver reliable data streams to downstream consumers
  • Schema Analysis & Optimization: Evaluate existing database schemas, identify optimization opportunities, recommend structural improvements, and ensure database integrity throughout changes
  • Change Data Capture & Auditing: Design and implement comprehensive change auditing solutions that track data modifications, provide audit trails, and support compliance requirements
  • Data Governance & Documentation: Develop and maintain a data catalog and comprehensive schema documentation to facilitate seamless integration with application development teams

Requirements

  • Database Expertise: Deep proficiency in PostgreSQL database design, administration, and optimization; strong understanding of relational database principles and SQL
  • Data Migration: Proven experience migrating large enterprise databases (Oracle to PostgreSQL preferred) with strong change management practices
  • Cloud Infrastructure: Hands-on experience with AWS services, particularly RDS, EC2, and associated networking and security configurations
  • Streaming & Real-Time Processing: Solid experience with Apache Kafka, Apache Flink, and data lakehouse technologies (Hudi, Delta Lake, or similar)
  • Data Modeling: Ability to design normalized and denormalized schemas, understand trade-offs, and optimize for both OLTP and analytical workloads
  • Change Data Capture (CDC): Experience implementing CDC patterns and audit logging systems for tracking data lineage and changes
  • Communication: Strong ability to translate complex data concepts for technical and non-technical stakeholders; skilled at documenting architectures and schemas

Nice-to-have / preferred skills

  • Experience with AWS Data Pipeline tools (Glue, Lambda, or Step Functions)
  • Knowledge of data quality and validation frameworks
  • Familiarity with infrastructure-as-code tools (Terraform, CloudFormation)
  • Prior experience in application modernization or legacy system replacements
  • Understanding of data security, encryption, and compliance requirements (GDPR, HIPAA, etc.)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…