data engineer

Balbix, Inc.

United States

about 1 month ago

Apply on jobs.lever.co

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

jobs.lever.co

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Big Data Computer Programming Databases Information Engineering Data Structures DevOps Distributed Systems Elasticsearch Python (Programming Language) PostgreSQL

+16 more

MongoDB NoSQL Redis Prometheus Web Services Backend Information Technology Druid Influxdb Cassandra Data Analytics Search Engines Front End Software Development Restful APIs Data Pipelines Microservices

Job description

As a senior data engineer you will work on complex data pipelines dealing with petabytes of data. Balbix platform is used as one of the critical security tools by the CIOs, CISOs, and the sec-ops teams of small, medium and large sized enterprises including Fortune 10 companies around the world. You will solve problems related to massive cybersecurity and IT data sets. You will collaborate closely with our data scientists, threat researchers and network experts to solve real-world problems plaguing cybersecurity. This role requires excellent algorithm, programming and testing skills as well as experience in large-scale data engineering projects., * Design and implement the features and own the modules for ingesting, storing and manipulating large data sets for a variety of cybersecurity use-cases

Write code to provide backend support for data-driven UI widgets, web dashboards, workflows, search and API connectors
Design and implement web services, rest APIs, and microservices
Build production quality solutions that balance complexity and meet acceptance criteria of functional requirements
Work with multiple-interfacing teams, including ML, UI, backend and data engineering

Requirements

Driven to experience and learn more about design, architecture, and take on progressive roles
Collaborative and comfortable working with across teams including data engineering, front end, product management, and DevOps
Responsible and like to take ownership of challenging problems
An effective communicator, including good documentation practices and articulating thought processes in a team setting
Comfortable with working in an agile environment
Curious about technology and the industry, and a constant learner, * MS/BS +3 years in Computer Science or a related field
Expert programming experience with Python, Java, or Scala
Good working knowledge of SQL databases such as Postgres and NoSQL databases such as MongoDB, Cassandra, Redis
Experience with search engine database such as ElasticSearch is preferred
Time-series databases such as InfluxDB, Druid, Prometheus
Strong computer science fundamentals: data structures, algorithms, and distributed systems