Data Engineer Architect III

Hudson
Cincinnati, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Cincinnati, United States of America

Tech stack

API
Cloud Storage
Databases
Continuous Integration
Custom Software
Data Integration
ETL
Data Security
Data Systems
Linux
File Systems
Distributed Systems
Hadoop Distributed File System
Hive
Systems Analysis
Python
Performance Tuning
Cloudera
Data Streaming
Management of Software Versions
Scripting (Bash/Python/Go/Ruby)
Low Latency
Kafka
Apache Nifi
Data Pipelines

Job description

We are seeking an experienced Data Engineer/Architect with strong expertise in Cloudera NiFi, data pipeline optimization, and ETL/ELT processes. This role involves assessing, enhancing, and supporting scalable data integration solutions., NiFi Platform Assessment & Optimization

  • Evaluate existing Cloudera NiFi flows for performance, scalability, and maintainability
  • Identify improvements to simplify architecture and reduce operational overhead
  • Recommend best practices, reusable patterns, and standards

Data Integration & Pipeline Support

  • Develop and enhance ETL/ELT pipelines using NiFi
  • Integrate data from databases, APIs, filesystems, streaming platforms, and cloud storage
  • Troubleshoot pipeline failures, latency, and performance issues
  • Implement monitoring, error handling, and recovery mechanisms

Python & Custom Development

  • Use Python for data transformation, automation, and scripting
  • Build integrations between NiFi and external systems

Governance, Security & Operations

  • Ensure secure data movement with authentication, authorization, and encryption
  • Support deployment, versioning, and operational processes
  • Align platform changes with compliance and operational standards

Advisory & Collaboration

  • Act as a technical advisor to data and platform teams
  • Document findings, recommendations, and improvements
  • Provide knowledge transfer and long-term support guidance

Requirements

Do you have experience in Systems analysis?, * Hands-on experience with Cloudera NiFi in production

  • Strong understanding of ETL/ELT and data pipeline architecture
  • Proficiency in Python for scripting and automation
  • Experience with Linux and distributed systems
  • Ability to analyze and optimize existing data systems

Preferred Skills

  • Experience with Cloudera ecosystem (Kafka, HDFS, Hive, Iceberg)
  • Familiarity with CI/CD for data pipelines
  • Experience in monitoring and performance tuning
  • Exposure to cloud or hybrid data environments

Engagement Expectations

  • Hands-on, deliverables-focused role
  • Ability to work independently and collaborate with teams
  • Strong communication and documentation skills

Apply for this position