> Markdown version of [/jobs/ext/4323381-senior-data-engineer-scala-spark-cloudera-cdp](https://www.wearedevelopers.com/jobs/ext/4323381-senior-data-engineer-scala-spark-cloudera-cdp). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP - **Company:** J2B Global LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Application Frameworks, Application Performance Management, Confluence, JIRA, Batch Processing, Data Infrastructure, Database Development, IBM InfoSphere DataStage, Linux, Distributed Computing Environment, Drools, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Performance Tuning, Query Optimization, Cloudera, Scala (Programming Language), Apache Yarn, Cloudera Manager, Apache Spark, Git, Software Version Control - **Published:** October 31, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e349a8872e9ea820 ## About the Role Visa: Any NOW HIRING | SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP Location: Remote Experience: 7+ Years Domain: Medicaid / Healthcare Data Processing us Visa : H1B & USC ( No GC ) We are looking for an experienced Senior Data Engineer to take ownership of a mission-critical enterprise data processing platform supporting Medicaid Encounter Processing and enterprise data ingestion. The ideal candidate will have strong hands-on expertise in Scala, Apache Spark, Hive, Drools, and Cloudera Data Platform (CDP), with proven experience maintaining and troubleshooting production-scale distributed data processing applications. Required Technical Skills: Scala - hands-on development Apache Spark 2.x / 3.x Cloudera Data Platform (CDP) 7.x or equivalent enterprise Hadoop distribution Apache Hive 3.x and Hive table management Drools Rules Engine - business rule implementation SQL development and query optimization Linux production support and troubleshooting Git and modern version control practices Spark batch processing, performance tuning, and production issue resolution Key Responsibilities: Own and enhance the Scala/Spark application framework for Medicaid Encounter Processing. Maintain and implement Drools business rules and regulatory changes. Manage enterprise data ingestion and Spark/Hive batch workflows. Troubleshoot production defects and distributed Spark application issues. Handle production releases, deployments, and version management. Optimize application performance, reliability, and scalability. Support Cloudera platform monitoring and operational administration. Maintain technical documentation and operational procedures. Preferred Qualifications: Medicaid / Healthcare data processing experience Medicaid Encounter Processing experience Cloudera Manager, HDFS, and YARN IBM DataStage integration AWS infrastructure supporting Cloudera Agile, Jira, and Confluence