Cloudera NiFi Data Engineer/Architect

Eliassen Group
Cincinnati, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 152K

Job location

Cincinnati, United States of America

Tech stack

API
Cloud Storage
Databases
Continuous Integration
Data Architecture
ETL
Data Security
Linux
File Systems
Distributed Data Store
Distributed Systems
Hadoop Distributed File System
Hive
Python
Linux System Administration
Cloudera
Data Streaming
Management of Software Versions
Data Processing
Scripting (Bash/Python/Go/Ruby)
Kafka
Apache Nifi
Data Pipelines

Job description

Our client seeks a Data Engineer/Architect III to assess and optimize Cloudera NiFi implementations, strengthen ETL and ELT pipelines, and enable reliable, secure data movement. The role requires hands-on engineering in Linux-based and distributed environments, strong Python skills for transformation and automation, and the ability to deliver clear, actionable recommendations. The engagement is deliverables-focused with collaboration across internal stakeholders., * Review existing Cloudera NiFi flows and architectures for efficiency, scalability, and maintainability.

  • Assess current use cases to ensure NiFi is being applied appropriately and effectively.
  • Identify opportunities to simplify flow designs, reduce operational overhead, and improve performance.
  • Provide recommendations on best practices, standards, and reusable patterns.
  • Support and enhance ETL and ELT pipelines built on NiFi.
  • Integrate data from diverse sources including databases, APIs, filesystems, streaming platforms, and cloud storage.
  • Troubleshoot data flow failures, latency issues, and throughput constraints.
  • Implement robust error handling, monitoring, and recovery mechanisms.
  • Use Python for transformations, scripting, automation, and custom processor logic where applicable.
  • Support integration between NiFi and external systems using custom scripts or utilities.
  • Apply best practices for secure data movement, authentication, authorization, and encryption.
  • Assist with flow versioning, deployment processes, and operational runbooks.
  • Collaborate with internal teams to align platform changes with operational and compliance requirements.
  • Act as a technical advisor to internal data and platform teams.
  • Document findings, recommendations, and implemented improvements and provide knowledge transfer.

Requirements

Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance., * Proven, hands-on experience with Cloudera NiFi in production environments.

  • Strong knowledge of ETL/ELT concepts and modern data pipeline architectures.
  • Proficiency in Python for data processing, scripting, and automation.
  • Experience with Linux-based systems and distributed environments.
  • Ability to analyze existing implementations and deliver optimization recommendations.
  • Preferred: Experience with Cloudera ecosystem components such as Kafka, HDFS, Hive, and Iceberg.
  • Preferred: Familiarity with CI/CD practices for data pipelines.
  • Preferred: Experience with monitoring and tuning distributed data platforms.
  • Preferred: Exposure to cloud and hybrid data architectures.

Benefits & conditions

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality. If anyone reaches out to you about an open position connected with Eliassen Group, please ensure that you are working directly with us by confirming the following:

When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.

About the company

Eliassen Group is a strategic consulting firm that helps organizations reach further and achieve more through our technology, business advisory, and life sciences solutions. For nearly 40 years, we have combined exceptional people, deep domain expertise, and intelligent capabilities to expand our clients' capacity and accelerate meaningful outcomes. We are driven by a purpose to positively impact the lives of our employees, clients, consultants, and the communities we serve.

Apply for this position