Senior Data Engineer

KNOWS WHAT SHE WANTS, LLC
New York, NY, United States
17 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Experience level
Expert
Experience required
2 years minimum
Compensation
$72,000.0 - $84,000.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Airflow Amazon Web Services Cloud Computing Databases Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Database Design Linux Monitoring of Systems
+24 more
Java Web Services Microsoft SQL Server Object-Oriented Software Development Oracle (Applications) Performance Tuning Redis Prometheus Standard Sql Software Engineering SQL Databases Management of Software Versions Zabbix Datadog Cloud Platform System Data Ingestion System Availability Snowflake Grafana Kubernetes Information Technology Apache Kafka Vertica Data Pipelines Microservices

Job description

Salary: $6,000 - $7,000 per month Location: New York, USAEmployment option: RemoteJob type: Full time, Part timeJob Summary:Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.SkillsMust HaveHard skills: - novice in: AWS, Database Design - beginner in: MS SQL Server, Linux - competent in: Databases, Performance Tuning, SQL, Microservices - proficient in: ETL, Prometheus, Database Management, Service Level Agreement SLA, Snowflake, Data Pipelines, JAVA, GrafanaNice-to-haveHard skills: - novice in: Automation - beginner in: Oracle - proficient in: ClickHouseSoft skills: - proficient in: Communication SkillsJob DescriptionAdditional RequirementsRequired skillsEducation - BSc. in Computer Sciences from a top university, or equivalent.Java - Strong background as a software engineer with at least 2+ years experience with Java.DB - 8+ years in data engineering, and data pipeline development on high-volume production environments.Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).Experience in object-oriented development. Should have strong software engineering foundations.Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.Experience with designing infrastructure to maintain high availability SLAs.Experience with monitoring and managing production environments.Strong communication skills.Nice to have - Experience working in fintech or trading industries.ResponsibilitiesDesign and develop the data’s team micro services - Java services running on K8S.Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.Develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.Enrich financial data through third-party data integrations.Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.Plan and communicate integrations with other teams that consume the data and use it for insights creation.Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.Benefits - Profit sharing - Food providedAbout CompanyCompany OverviewEnabling Safer Crypto MarketsOur mission is to enable safer crypto trading throughout the investment journey across all centralized and DeFi markets. As the founder of industry leading initiatives like the Crypto Market Integrity Coalition and DACOM Summit, and in everything we do, Solidus is deeply committed to ushering the financial markets of tomorrow. Salary: $6,000 - $7,000 per month Location: New York, USAEmployment option: RemoteJob type: Full time, Part timeJob Summary:Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.SkillsMust HaveHard skills: - novice in: AWS, Database Design - beginner in: MS SQL Server, Linux - competent in: Databases, Performance Tuning, SQL, Microservices - proficient in: ETL, Prometheus, Database Management, Service Level Agreement SLA, Snowflake, Data Pipelines, JAVA, GrafanaNice-to-haveHard skills: - novice in: Automation - beginner in: Oracle - proficient in: ClickHouseSoft skills: - proficient in: Communication SkillsJob DescriptionAdditional RequirementsRequired skillsEducation - BSc. in Computer Sciences from a top university, or equivalent.Java - Strong background as a software engineer with at least 2+ years experience with Java.DB - 8+ years in data engineering, and data pipeline development on high-volume production environments.Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).Experience in object-oriented development. Should have strong software engineering foundations.Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.Experience with designing infrastructure to maintain high availability SLAs.Experience with monitoring and managing production environments.Strong communication skills.Nice to have - Experience working in fintech or trading industries.ResponsibilitiesDesign and develop the data’s team micro services - Java services running on K8S.Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.Develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.Enrich financial data through third-party data integrations.Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.Plan and communicate integrations with other teams that consume the data and use it for insights creation.Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.Benefits - Profit sharing - Food providedAbout CompanyCompany OverviewEnabling Safer Crypto MarketsOur mission is to enable safer crypto trading throughout the investment journey across all centralized and DeFi markets. As the founder of industry leading initiatives like the Crypto Market Integrity Coalition and DACOM Summit, and in everything we do, Solidus is deeply committed to ushering the financial markets of tomorrow. Salary: $6,000 - $7,000 per month Location: New York, USAEmployment option: RemoteJob type: Full time, Part timeJob Summary:Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.SkillsMust HaveHard skills: - novice in: AWS, Database Design - beginner in: MS SQL Server, Linux - competent in: Databases, Performance Tuning, SQL, Microservices - proficient in: ETL, Prometheus, Database Management, Service Level Agreement SLA, Snowflake, Data Pipelines, JAVA, GrafanaNice-to-haveHard skills: - novice in: Automation - beginner in: Oracle - proficient in: ClickHouseSoft skills: - proficient in: Communication SkillsJob DescriptionAdditional RequirementsRequired skillsEducation - BSc. in Computer Sciences from a top university, or equivalent.Java - Strong background as a software engineer with at least 2+ years experience with Java.DB - 8+ years in data engineering, and data pipeline development on high-volume production environments.Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).Experience in object-oriented development. Should have strong software engineering foundations.Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.Experience with designing infrastructure to maintain high availability SLAs.Experience with monitoring and managing production environments.Strong communication skills.Nice to have - Experience working in fintech or trading industries.ResponsibilitiesDesign and develop the data’s team micro services - Java services running on K8S.Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.Develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.Enrich financial data through third-party data integrations.Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.Plan and communicate integrations with other teams that consume the data and use it for insights creation.Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.Benefits - Profit sharing - Food providedAbout CompanyCompany OverviewEnabling Safer Crypto MarketsOur mission is to enable safer crypto trading throughout the investment journey across all centralized and DeFi markets. As the founder of industry leading initiatives like the Crypto Market Integrity Coalition and DACOM Summit, and in everything we do, Solidus is deeply committed to ushering the financial markets of tomorrow.

Requirements

Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.

As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.

Skills

Must Have

Hard skills:

  • novice in: AWS, Database Design
  • beginner in: MS SQL Server, Linux
  • competent in: Databases, Performance Tuning, SQL, Microservices
  • proficient in: ETL, Prometheus, Database Management, Service Level Agreement SLA, Snowflake, Data Pipelines, JAVA, Grafana Nice-to-have

Hard skills:

  • novice in: Automation
  • beginner in: Oracle
  • proficient in: ClickHouse Soft skills:

  • proficient in: Communication Skills, * Education - BSc. in Computer Sciences from a top university, or equivalent.
  • Java - Strong background as a software engineer with at least 2+ years experience with Java.
  • DB - 8+ years in data engineering, and data pipeline development on high-volume production environments.
  • Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
  • Experience in object-oriented development. Should have strong software engineering foundations.
  • Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.
  • Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.
  • Experience with designing infrastructure to maintain high availability SLAs.
  • Experience with monitoring and managing production environments.
  • Strong communication skills.

Nice to have - Experience working in fintech or trading industries.

About the company

Enabling Safer Crypto Markets

Our mission is to enable safer crypto trading throughout the investment journey across all centralized and DeFi markets. As the founder of industry leading initiatives like the Crypto Market Integrity Coalition and DACOM Summit, and in everything we do, Solidus is deeply committed to ushering the financial markets of tomorrow.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…