Senior Software Engineer - Big Data

Deep East Texas Council of Governments
San Francisco, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

San Francisco, United States of America

Tech stack

Apache HTTP Server
Big Data
Cloud Computing
Data Integration
Data Structures
Data Flow Control
Hadoop
HBase
Hive
MongoDB
Object-Oriented Software Development
Software Deployment
Software Engineering
Data Processing
Google Cloud Platform
Data Storage Technologies
Spark
Containerization
Data Lake
Apache Flume
Kubernetes
Information Technology
Apache Flink
Cassandra
Data Analytics
Kafka
Apache Nifi
Machine Learning Operations
Apache Beam
Docker
Databricks

Job description

  • We're working on building an efficient marketplace of jobseekers and employers and need generalist software engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job
  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Requirements

  • 5+ years of professional software development experience with a focus on big data technologies
  • Experience with Hadoop, Spark, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes
  • (Desirable) 8+ years of professional software development experience, with a focus on big data technologies
  • (Desirable) BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • (Desirable) Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • (Desirable) Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • (Desirable) Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

Apply for this position