Data Engineer (ETL)
Role details
Job location
Tech stack
Job description
job summary: Collaborate with peers through code reviews, pair programming or interactive discussions daily.
Ability to work across multiple squads and adaptable to change.
Embrace customer-first mentality and enjoy developing user-friendly internet facing web applications that tackle real life problems.
Have a passion for following outstanding software engineering practices and always looking to improve your engineering skills and industry knowledge.
Bring a data-driven & collaborative approach to decision making, both in day-to-day work and in making strategic trade-offs.
location: Durham, North Carolina job type: Contract salary: $75 - 76 per hour work hours: 8am to 5pm education: Bachelors
responsibilities:
- Bachelor's degree in computer science, Information Systems, or a related field
- Proven track record in data engineering
- 10+ years' experience developing Spark Services for Data movement.
- Schedule, Monitor and debug ETL Spark Batch.
- Hands on Experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application.
- Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs.
- Utilizing Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte.
- Experience with cloud-based data warehousing and data lake solutions such as Snowflake
- Experience with data storage and data management for large datasets like parquet, HDF5, etc.
- Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS .
qualifications: Champions innovative technology solutions to resolve sophisticated business problems
Works across groups to find opportunities for organization-wide technology initiatives
Brings external information, ideas, and expertise back to the team
Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning
Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
,
- Bachelor's degree in computer science, Information Systems, or a related field
- Proven track record in data engineering
- 10+ years' experience developing Spark Services for Data movement.
- Schedule, Monitor and debug ETL Spark Batch.
- Hands on Experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application.
- Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs.
- Utilizing Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte.
- Experience with cloud-based data warehousing and data lake solutions such as Snowflake
- Experience with data storage and data management for large datasets like parquet, HDF5, etc.
- Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS.
Requirements
Champions innovative technology solutions to resolve sophisticated business problems Works across groups to find opportunities for organization-wide technology initiatives Brings external information, ideas, and expertise back to the team Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples.