Data Reliability Engineer / PostgreSQL DBA
Tekshapers Inc
Jersey City, United States of America
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Jersey City, United States of America
Tech stack
Airflow
Big Data
Cloud Database
Databases
Directed Acyclic Graph (Directed Graphs)
Data Integrity
ETL
Data Warehousing
PostgreSQL
Performance Tuning
Prometheus
Debezium
Information Technology
Kafka
Cloudwatch
Terraform
Data Pipelines
Job description
As a Data Reliability Engineer II, you will play a crucial role in developing, optimizing, and managing several large data lakes and data warehouses, comprising data from multiple disparate sources., * Proactively monitor PostgreSQL RDS instances for performance, availability, and resource utilization (CPU, memory, storage, connections) using established monitoring tools (e.g., CloudWatch, Prometheus).
- Assist in identifying performance bottlenecks in PostgreSQL RDS. Apply basic performance tuning techniques like reviewing query execution plans, adding missing indexes, and recommending parameter adjustments.
- Monitor the health and performance of Debezium and Kafka Connect connectors, identifying and troubleshooting basic issues related to data capture and delivery.
- Monitor ETL workflows and data pipelines for errors, performance bottlenecks, and processing delays. Troubleshoot and resolve issues to ensure reliable and timely data movement.
- Provide support for data related issues and participate in root cause analysis.
- Monitor the execution of Apache Airflow DAGs, identify failed tasks, and troubleshooting and re-runs.
- Develop and maintain automation scripts and infrastructure as code (IAC) templates (e.g., using Crossplane, Terraform) to automate routine database tasks, deployments, and updates.
- Participate in on-call rotations to respond to database-related incidents and perform troubleshooting and root cause analysis.
- Assist in implementing and maintaining security best practices for cloud databases, including access controls, encryption, and compliance with regulatory requirements.
Requirements
Mandatory Skills : PostgreSQL DBA, * Bachelor's degree in computer science, Information Technology, or a related field.
- 10 plus years of experience in database administration, with a focus on PostgreSQL.
- 5-7 years of hands-on experience with PostgreSQL RDS.