Senior Data Engineer/Lead

We are actively seeking a talented and motivated Senior Data Engineer/Lead to join a dynamic and energetic team. As a key contributor to agile scrum teams, you will collaborate closely with the Customer Insights team, showcasing strong technical expertise in Hadoop/Spark and real-time data processing technologies like Kafka and NoSQL databases. The ideal candidate excels at collaborating with both onshore and offshore team members and will have the opportunity to lead and take responsibility for end-to-end solution design and delivery. Responsibilities:

• Collaborate closely with the Customer Insights team as a key contributor to agile scrum teams
• Function as an individual contributor and lead end-to-end solution design and delivery
• Showcase strong technical expertise in Hadoop/Spark and related technologies
• Work with real-time data processing technologies like Kafka, Spark Streaming, and NoSQL databases

• Bachelor's or Master's degree in Science or Engineering, or a related field
• Minimum of 8 years of industry experience, with at least 5 years focused on hands-on work in Big Data and real-time data processing technologies
• Strong expertise in Hadoop stack technologies, such as HDFS, Spark, Yarn, Hive, Sqoop, Impala, and Hue
• Proficiency in real-time streaming technologies like Kafka (KStreams, KTable) and Spark Streaming
• Strong knowledge of NoSQL databases like Redis, MongoDB, or HBase
• Proficiency in programming languages such as Python, Scala, Java, and Bash/Shell Scripting
• Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications
• Strong understanding of distributed systems, data partitioning, and fault-tolerant architectures

Desired skills:

• Experience with additional real-time streaming technologies like Flink or Storm
• Familiarity with Cloud Technologies such as Azure, AWS, or GCP
• Working knowledge of machine learning algorithms, statistical analysis, and programming languages (Python or R) to conduct data analysis and develop predictive models
• Proficiency in Data Integration and Data Security within real-time and Big Data ecosystems, including knowledge of Kerberos
• Strong command of Visual Analytics Tools, with a focus on Tableau

Genesis10 is currently seeking a Senior Data Engineer/Lead for a contract position with a Global Financial Institution located in Pennington, NJ. This is a 12+ month contract opportunity., Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals. For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: * Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years. * The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years. * Access to an experienced, caring recruiting team (more than 7 years of experience, on average.) * Behavioral Health Platform * Medical, Dental, Vision * Health Savings Account * Voluntary Hospital Indemnity (Critical Illness & Accident) * Voluntary Term Life Insurance * 401K * Sick Pay (for applicable states/municipalities) * Commuter Benefits (Dallas, NYC, SF, and Illinois) For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website. Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.