Data Ops Engineer

• Monitor and troubleshoot data ingestion/transformation workflows across hybrid environments.
• Manage job schedules, track failures, and implement fixes to ensure smooth pipeline execution.
• Automate repetitive operational tasks and contribute to CI/CD improvements.
• Collaborate with platform engineers, release managers, and global teams for stable releases.
• Perform RCA, maintain SLAs, and continuously optimize performance.
• Maintain operational documentation, runbooks, and health-check procedures.

Do you have experience in Technical writing?, Do you have a Bachelor's degree?, * Strong hands-on experience with HDFS, Spark, Hive/Impala, and Python-based data processing.

• Expertise in debugging ingestion failures, pipeline issues, and performance bottlenecks.
• Knowledge of workflow orchestrators such as Airflow, Oozie, ADF.
• Experience with Git, artifact management, and CI/CD tools (Azure DevOps/Jenkins).
• Incident management: triage, RCA, remediation; ability to handle on-call rotation.
• Monitoring using Cloudera Manager, logs, and metrics with focus on SLA/MTTR.
• Strong Shell scripting skills and automation of operational tasks.
• Basic understanding of Azure/Databricks jobs, clusters, storage.

Functional Skills

• Strong analytical thinking and structured problem-solving.
• Ability to document runbooks and operational playbooks clearly.
• Effective communication with cross-functional teams including release management and offshore teams.
• Good understanding of production governance and stability requirements., Qualifications : BACHELOR OF COMPUTER SCIENCE

3.93.9 out of 5 stars Jersey City, NJ $100,000 - $125,000 a year, Pulled from the full job description

• Pet insurance
• Health insurance
• Vision insurance
• Dental insurance
• Commuter assistance, Discretionary Annual Incentive. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans. Family Support: Maternal & Parental Leaves. Insurance Options: Auto & Home Insurance, Identity Theft Protection. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement. Time Off: Vacation, Time Off, Sick Leave & Holidays. Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing. Salary Range: $100,000 - $125,000 a year