Data Reliability Engineer- PostgreSQL
Dotcom Team, LLC
Morristown, NJ, United States
6 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source
Tech stack
Airflow
Amazon Web Services
Big Data
Cloud Database
Databases
Directed Acyclic Graph (Directed Graphs)
Information Engineering
Data Integrity
Extract Transform Load (ETL)
Data Loss
Data Warehousing
Database Queries
+11 more
Database Security
PostgreSQL
Performance Tuning
Prometheus
SQL Databases
Debezium
Information Technology
Apache Kafka
Cloudwatch
Terraform
Data Pipelines
Job description
As a Data Reliability Engineer, you will play a crucial role in developing, optimizing, and managing several large data lakes and data warehouses, comprising data from multiple disparate sources., * Need a data engineer with extensive experience in PostgreSQL and AWS, who has previous experience creating data pipelines (ETL/ELT). He / She who have previous experience in creating data pipelines ( ETL / ELT)
- Proactively monitor PostgreSQL RDS instances for performance, availability, and resource utilization (CPU, memory, storage, connections) using established monitoring tools (e.g., CloudWatch, Prometheus).
- Assist in identifying performance bottlenecks in PostgreSQL RDS. Apply basic performance tuning techniques like reviewing query execution plans, adding missing indexes, and recommending parameter adjustments.
- Monitor the health and performance of Debezium and Kafka Connect connectors, identifying and troubleshooting basic issues related to data capture and delivery.
- Monitor ETL workflows and data pipelines for errors, performance bottlenecks, and processing delays. Troubleshoot and resolve issues to ensure reliable and timely data movement.
- Provide support for data-related issues and participate in root cause analysis.
- Monitor the execution of Apache Airflow DAGs, identify failed tasks, and troubleshoot and re-run them.
- Develop and maintain automation scripts and infrastructure as code (IAC) templates (e.g., using Crossplane, Terraform) to automate routine database tasks, deployments, and updates.
- Participate in on-call rotations to respond to database-related incidents and perform troubleshooting and root cause analysis.
- Assist in implementing and maintaining security best practices for cloud databases, including access controls, encryption, and compliance with regulatory requirements.
- Regularly audit and assess database security configurations.
- Configure and manage database backup and recovery strategies to ensure data integrity and availability in case of failures or data loss.
- Analyse database query performance and collaborate with developers to optimize SQL queries and schemas.
- Participate in continuous improvement initiatives to enhance the reliability, scalability, and performance of cloud databases.
Requirements
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 5-8 years of experience in data Engineering, with a focus on PostgreSQL.
- 2-4 years of hands-on experience with PostgreSQL RDS
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…