Data Platform Engineer

Harness Inc.
Mountain View, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 220K

Job location

Mountain View, United States of America

Tech stack

Java
Amazon Web Services (AWS)
Azure
Big Data
Google BigQuery
Continuous Integration
Data Validation
Information Engineering
Data Infrastructure
Data Integrity
ETL
Data Visualization
Data Warehousing
Database Queries
Software Debugging
DevOps
Document-Oriented Databases
Python
Machine Learning
NoSQL
Power BI
Tableau
Google Cloud Platform
Data Ingestion
Spark
Containerization
Information Technology
Data Analytics
Kafka
Looker Analytics
Data Pipelines
Docker

Job description

We are seeking a talented and experienced Data Platform Engineer to join our team as the Technical Lead. The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and infrastructure. They will work closely with cross-functional teams to understand data requirements, implement solutions, and ensure data quality and reliability. The data engineer will also be involved in optimizing data processes and supporting data analytics initiatives., * Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.

  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
  • Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
  • Optimize and tune data pipelines for performance and efficiency.
  • Troubleshoot and debug data-related issues, and provide timely resolution.
  • Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
  • Document data architecture, processes, and workflows.
  • Provide support and guidance to junior members of the team.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
  • 9+ yrs of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
  • Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Strong SQL skills and experience working with relational and NoSQL databases.
  • Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Experience

  • Experience with containerization and orchestration tools such as Docker and Kubernetes.
  • Knowledge of machine learning techniques and frameworks.
  • Experience with DevOps practices and tools for CI/CD.

Benefits & conditions

Mountain View, CA - Hybrid (3 days / week onsite) What you will have at Harness

  • Competitive salary
  • Comprehensive healthcare benefits
  • Flexible Spending Account (FSA)
  • Flexible work schedule
  • Employee Assistance Program (EAP)
  • Flexible Time Off and Parental Leave
  • Monthly, quarterly, and annual social and team building events
  • Monthly internet reimbursement

Pay transparency

$180,000-$220,000 USD

Harness in the news:

  • Accelerating Our Mission to Bring AI to Everything After Code
  • Goldman Sachs leads investment in software delivery startup Harness at $5.5 billion valuation
  • How Harness runs 16 "startups within a startup" at scale | Jyoti Bansal
  • Harness Research Shows AI Visibility Crisis Fueling Security Nightmare
  • Harness has been named to the Inc. Power Partner list for software delivery success

About the company

With a global team across 26 offices and 27 countries, Harness is shaping the future of AI software delivery - and we're looking for exceptional talent to help us move even faster.

Apply for this position