Big Data Engineer - Onsite
Genesis10
Jacksonville, United States of America
yesterday
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 150KJob location
Jacksonville, United States of America
Tech stack
PHP
Agile Methodologies
Big Data
Cloudera Impala
Computer Programming
Relational Databases
Database Queries
Linux
Distributed Systems
Elasticsearch
Hadoop
MapReduce
HBase
Hive
JSON
Python
MySQL
NoSQL
Performance Tuning
Queueing Systems
Cloudera
Scala
Shell Script
Software Engineering
Solr
SQL Databases
Sqoop
Subversion
XML
Data Ingestion
Spark
GIT
Build Management
Kafka
Bitbucket
Spark Streaming
Kibana
REST
Software Version Control
Data Pipelines
Jenkins
Job description
- Develop and manage data ingestion from various sources including message queues, file shares, REST APIs, and relational databases
- Design and build end-to-end Near-Real Time and Batch Data Pipelines
- Perform performance tuning for Spark/MapReduce and SQL jobs
- Work within an Agile development process through all phases of the Software Development Life Cycle
- Utilize source code and version control systems for code management
- Work with minimal supervision and collaborate effectively within a team of diverse skill sets
- Comprehend customer requests to provide correct solutions and resolve complex issues
Requirements
- Strong SQL skills (MySQL, HIVE, Impala, SPARK SQL)
- Experience with data ingestion and data formats (json, csv, xml)
- Experience with SPARK Structured Streaming, Hadoop/Big Data, and Distributed Systems
- Working experience with Spark, Sqoop, Kafka, MapReduce, and NoSQL Databases (HBase, SOLR)
- Experience with CDP/HDP (Cloudera or Hortonworks), Elastic Search, and Kibana
- Hands-on programming experience in at least one of the following: Scala, Python, PHP, or Shell Scripting
- Proficiency with the Linux operating system
- Experience with Source Code and Version Control systems (SVN, Git, Bit Bucket)
- Experience with Jenkins and Jar management
- Strong analytical and problem-solving skills
- Ability to adapt and learn new technologies
About the company
Genesis10 is currently seeking a Big Data Engineer for an Onsite position with a Global Financial Institution located in Charlotte, NC, Denver, CO, Jacksonville, FL or Chicago, IL. This is a 12+ month contract opportunity., Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:
* Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
* The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
* Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
* Behavioral Health Platform
* Medical, Dental, Vision
* Health Savings Account
* Voluntary Hospital Indemnity (Critical Illness & Accident)
* Voluntary Term Life Insurance
* 401K
* Sick Pay (for applicable states/municipalities)
* Commuter Benefits (Dallas, NYC, SF, and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Genesis10 is an Equal Opportunity Employer/Minorities/Female/Disabled/Veteran