Senior Data Engineer
Bartech Staffing
Matthews, NC, United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Amazon Elastic Compute Cloud
Apache HTTP Server
Audit Trail
Cloud Computing
Databases
Data Governance
Data Integrity
Data Migration
Data Security
Relational Databases
PostgreSQL
Online Transaction Processing
+19 more
Oracle Databases
Oracle (Applications)
Standard Sql
Software Engineering
Data Streaming
Real Time Systems
Change Data Capture
Cloudformation
Amazon Relational Database Service
Data Lakes
Infrastructure Automation Frameworks
Data Lineage
Apache Flink
Real Time Data
Apache Kafka
Data Lakehouse
Hardware Infrastructure
Terraform
Data Pipelines
Job description
- Database Architecture & Design: Design and implement PostgreSQL databases and schemas from the ground up, ensuring optimal performance, scalability, and maintainability
- Legacy System Migration: Lead the migration of large-scale Oracle databases from on-premises infrastructure to AWS RDS PostgreSQL clusters, managing data integrity and minimizing downtime
- Real-Time Data Products: Build and optimize data products leveraging Apache Kafka, Apache Flink, and Apache Hudi to deliver reliable data streams to downstream consumers
- Schema Analysis & Optimization: Evaluate existing database schemas, identify optimization opportunities, recommend structural improvements, and ensure database integrity throughout changes
- Change Data Capture & Auditing: Design and implement comprehensive change auditing solutions that track data modifications, provide audit trails, and support compliance requirements
- Data Governance & Documentation: Develop and maintain a data catalog and comprehensive schema documentation to facilitate seamless integration with application development teams
Requirements
- Database Expertise: Deep proficiency in PostgreSQL database design, administration, and optimization; strong understanding of relational database principles and SQL
- Data Migration: Proven experience migrating large enterprise databases (Oracle to PostgreSQL preferred) with strong change management practices
- Cloud Infrastructure: Hands-on experience with AWS services, particularly RDS, EC2, and associated networking and security configurations
- Streaming & Real-Time Processing: Solid experience with Apache Kafka, Apache Flink, and data lakehouse technologies (Hudi, Delta Lake, or similar)
- Data Modeling: Ability to design normalized and denormalized schemas, understand trade-offs, and optimize for both OLTP and analytical workloads
- Change Data Capture (CDC): Experience implementing CDC patterns and audit logging systems for tracking data lineage and changes
- Communication: Strong ability to translate complex data concepts for technical and non-technical stakeholders; skilled at documenting architectures and schemas
Nice-to-have / preferred skills
- Experience with AWS Data Pipeline tools (Glue, Lambda, or Step Functions)
- Knowledge of data quality and validation frameworks
- Familiarity with infrastructure-as-code tools (Terraform, CloudFormation)
- Prior experience in application modernization or legacy system replacements
- Understanding of data security, encryption, and compliance requirements (GDPR, HIPAA, etc.)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦