SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP

J2B Global LLC
United States
19 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services Application Frameworks Application Performance Management Confluence JIRA Batch Processing Data Infrastructure Database Development IBM InfoSphere DataStage Linux Distributed Computing Environment
+13 more
Drools Apache Hadoop Hadoop Distributed File System Apache Hive Performance Tuning Query Optimization Cloudera Scala (Programming Language) Apache Yarn Cloudera Manager Apache Spark Git Software Version Control

Requirements

Visa: Any NOW HIRING | SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP Location: Remote Experience: 7+ Years Domain: Medicaid / Healthcare Data Processing us Visa : H1B & USC ( No GC ) We are looking for an experienced Senior Data Engineer to take ownership of a mission-critical enterprise data processing platform supporting Medicaid Encounter Processing and enterprise data ingestion. The ideal candidate will have strong hands-on expertise in Scala, Apache Spark, Hive, Drools, and Cloudera Data Platform (CDP), with proven experience maintaining and troubleshooting production-scale distributed data processing applications. Required Technical Skills: Scala - hands-on development Apache Spark 2.x / 3.x Cloudera Data Platform (CDP) 7.x or equivalent enterprise Hadoop distribution Apache Hive 3.x and Hive table management Drools Rules Engine - business rule implementation SQL development and query optimization Linux production support and troubleshooting Git and modern version control practices Spark batch processing, performance tuning, and production issue resolution Key Responsibilities: Own and enhance the Scala/Spark application framework for Medicaid Encounter Processing. Maintain and implement Drools business rules and regulatory changes. Manage enterprise data ingestion and Spark/Hive batch workflows. Troubleshoot production defects and distributed Spark application issues. Handle production releases, deployments, and version management. Optimize application performance, reliability, and scalability. Support Cloudera platform monitoring and operational administration. Maintain technical documentation and operational procedures. Preferred Qualifications: Medicaid / Healthcare data processing experience Medicaid Encounter Processing experience Cloudera Manager, HDFS, and YARN IBM DataStage integration AWS infrastructure supporting Cloudera Agile, Jira, and Confluence

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…