Cloudera Developer

Genesis10
Charlotte, NC, United States
about 1 month ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Data Analysis CA Workload Automation Ae Big Data Data Architecture Data Governance Data Integration Data Integrity Extract Transform Load (ETL) Data Visualization Database Queries Distributed Data Store Distributed Systems
+13 more
Apache Hadoop Apache Hive Python (Programming Language) MySQL Performance Tuning Cloudera Software Deployment Data Streaming Data Processing Apache Spark Pandas Pyspark Data Pipelines

Job description

As a Cloudera Developer, you will be responsible for developing and maintaining robust, scalable data solutions using the Cloudera platform. This role involves designing and implementing data processing pipelines and ingestion frameworks, primarily using PySpark, while working with cross-functional teams to meet data requirements and deliver actionable business insights., * Design, develop, and maintain data processing pipelines using Cloudera technologies such as Apache Hadoop, Apache Spark, Apache Hive, and Python

  • Utilize multiple architectural components in the design and development of client requirements
  • Maintain, improve, clean, and manipulate data for operational and analytical data systems
  • Develop and maintain data ingestion frameworks for efficiently extracting, transforming, and loading data from various sources
  • Collaborate with data engineers and data scientists to understand data requirements and translate them into technical specifications
  • Optimize and tune data processing jobs to ensure high performance and scalability
  • Implement data governance and security policies to ensure data integrity and compliance
  • Monitor and troubleshoot data processing jobs to identify and resolve issues in a timely manner
  • Document technical specifications, data flows, and data architecture diagrams
  • Adhere to team delivery/release process and cadence for code deployment and release

Requirements

  • 5-7 years of experience with distributed data/computing tools such as Hadoop, Hive, MySQL, etc.
  • Strong problem-solving skills with an emphasis on product development
  • Experience working with and creating data architectures
  • Proficient in Python programming for data processing, automation, and analytical solutions
  • Experience using PySpark for large-scale data processing and distributed computing environments
  • Strong SQL skills with experience developing complex queries, joins, aggregations, and performance optimization
  • Knowledge of ETL processes, data integration, and data quality best practices
  • Experience using pandas to cleanse, transform, and analyze large datasets
  • Experience working with AutoSys
  • Ability to analyze data, identify trends and anomalies, and deliver actionable business insights
  • Experience creating clear and effective data visualizations and dashboards
  • Excellent written and verbal communication skills for coordinating across teams

About the company

Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.

For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:

  • Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
  • The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
  • Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
  • Behavioral Health Platform
  • Medical, Dental, Vision
  • Health Savings Account
  • Voluntary Hospital Indemnity (Critical Illness & Accident), For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:52 min

Navigating data warehouse performance for application developers

Adnan Rahic · JS Congress

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all