Cloudera Data Engineer

Blu Omega
8 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 140K

Job location

Tech stack

Java
Amazon Web Services (AWS)
Azure
Bash
Big Data
Cloudera Impala
Software Quality
Continuous Integration
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Systems
Software Debugging
DevOps
Hadoop
Hive
Python
Meta-Data Management
Metadata Repositories
Performance Tuning
Cloudera
Scala
SQL Databases
Data Processing
Cloud Platform System
Data Ingestion
GitHub Copilot
Cloudera Manager
Spark
Generative AI
Build Management
Apache Nifi
Terraform
Data Pipelines

Job description

Blu Omega is looking for a Cloudera Data Engineer. In this role, you'll work with a variety of technologies across the Hadoop and Cloudera ecosystems to move, transform, and optimize data from multiple sources. You'll partner with data engineers, analysts, and developers to make sure the data infrastructure is efficient, scalable, and secure-enabling smarter, faster decisions for our clients.

You'll spend your days designing and deploying data solutions, improving data processing performance, and supporting the overall health of our data environment. This position is ideal for someone who enjoys hands-on technical work, problem-solving, and continuous learning in a collaborative, team-oriented setting.

Responsibilities:

  • Design and build data pipelines to extract, transform, and load (ETL) large data sets from multiple sources into the Cloudera environment.
  • Manage and optimize data infrastructure for high performance, reliability, and scalability across both on-premise and cloud environments.
  • Develop and maintain scripts and workflows using Python, Java, Scala, or Pig to automate data processing and integration tasks.
  • Collaborate with cross-functional teams to understand data requirements, develop solutions, and ensure data is accurate and available for analytics and reporting.
  • Monitor and troubleshoot Cloudera environments, leveraging tools such as Cloudera Manager and Hue for system health, tuning, and debugging.
  • Use generative AI tools (like GitHub Copilot, Codex, or Claude Code) to enhance development efficiency and code quality.

Requirements

  • 3+ years of experience using Hadoop technologies (including Spark) to ingest, transform, and process data
  • Experience with Cloudera installation, configuration, tuning, and administration
  • Experience developing and managing NiFi pipelines for data ingestion and transformation
  • Experience leveraging generative AI coding tools to assist in development
  • Experience working in SQL (Hive, Spark SQL, or Impala) for querying and managing data within the Cloudera ecosystem
  • Experience with public cloud platforms such as AWS or Microsoft Azure
  • Knowledge of Python, Java, Scala, or Bash for data engineering and automation
  • Possession of strong collaboration and communication skills with the ability to work effectively in a cross-functional team environment
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
  • Bachelor's degree

Nice to Have:

  • Experience with Terraform for infrastructure automation and deployment
  • Experience with with CI/CD tools and DevOps best practices
  • Knowledge of data governance, metadata management, and data catalog tools
  • Ability to optimize queries and resource usage for better performance and efficiency

Benefits & conditions

Salary Range: $125K - $140K Our final salary offer will be based on several factors, including depth of technical skills, work experience, education, certifications, and clearance

What Blu Omega Can Offer You:

  • Competitive benefits including Health Insurance, 401K w/ match, Paid Time Off and more.
  • Results driven culture that embrace our core values
  • Rewarding work contributing to our Nation's mission critical programs

About the company

Blu Omega is a Woman Owned Small Business Federal Technology services firm headquartered in Washington DC and supporting clients nationally. We provide Technology solutions for enterprise and government customers. Our team has a past performance in a diverse range of programs including those for Data Management, Cloud/Infrastructure, Software Development and Enterprise Applications.

Apply for this position