Data Reliability Engineer

Tiger Analytics
Bridgewater, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Bridgewater, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Bash
Big Data
Databases
Data Integrity
Data Warehousing
Database Security
Python
PostgreSQL
Workflow Management Systems
Data Processing
Scripting (Bash/Python/Go/Ruby)
Spark
Debezium
Information Technology
Kafka
Apache Nifi
Data Pipelines
Redshift

Job description

As a Data Reliability Engineer II, you will play a crucial role in developing, optimizing, and managing several large data lakes and data warehouses, comprising data from multiple disparate sources.

Requirements

  • Familiarity with data pipeline concepts and technologies like Debezium, Kafka Connect, Apache Nifi.

  • Basic understanding of Amazon Redshift and S3.

  • Exposure to Apache Spark for data processing.

  • Basic understanding of Apache Airflow for workflow orchestration.

  • Strong SQL scripting skills for querying and basic data manipulation.

  • Familiarity with scripting languages (e.g., Python, Bash) is a plus.

  • Knowledge of database security best practices, including access controls, encryption, and compliance with regulatory requirements (e.g., GDPR, HIPAA).

  • Having 'AWS Certified Database - Specialty'' certification is a plus

Experience and Qualifications:

  • Bachelor''s degree in computer science, Information Technology, or a related field.
  • 7 years of experience in database administration, with a focus on PostgreSQL.
  • 4 years of hands-on experience with PostgreSQL RDS.

Apply for this position