Data Engineer, Data Acquisition (Web Crawling & Pipelines)

Vagaro, Inc.
Pleasanton, United States of America
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 135K

Job location

Pleasanton, United States of America

Tech stack

JavaScript
API
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Big Data
Computer Programming
Databases
Data Cleansing
Data Deduplication
Information Engineering
ETL
Data Transformation
Distributed Systems
Python
Salesforce
Selenium
SQL Databases
Unstructured Data
Web Crawlers
Google Cloud Platform
Build Management
Playwright
Dynamic Content
Machine Learning Operations
Hubspot
Pagination
Data Pipelines

Job description

We are seeking a Data Acquisition Engineer to design, build, and scale systems that collect, process, and maintain high-quality external data from the web and third-party sources., * Design and build scalable web crawlers and scraping systems to extract structured and unstructured data

  • Collect data from websites, APIs, and databases to support sales and marketing initiatives
  • Handle dynamic content, pagination, and JavaScript-heavy sites
  • Perform data cleaning, preprocessing, and validation to ensure accuracy and usability
  • Deliver clean, structured datasets aligned to business requirements
  • Collaborate with sales, marketing, and product teams to align data efforts with business goals
  • Optimize pipelines for performance, scalability, and reliability
  • Ensure ethical, compliant data collection practices

Data Engineering & Infrastructure

  • Build ETL/ELT pipelines for ingestion, transformation, and storage
  • Implement schema design, deduplication, and change detection
  • Manage orchestration tools (Airflow, Prefect, etc.)
  • Work with cloud platforms (AWS, GCP, Azure) and databases

Requirements

Do you have experience in SQL?, * 3+ years of experience in web crawling, scraping, or data engineering

  • Strong programming skills in Python or JavaScript
  • Experience with tools like Scrapy, BeautifulSoup, Selenium, or Playwright
  • Understanding of HTTP, DOM parsing, and web architectures
  • Strong data cleaning and preprocessing skills
  • Proficiency in SQL and working with databases
  • Strong problem-solving skills and attention to detail
  • Excellent written and verbal communication skills, * Experience with distributed systems or large-scale data processing
  • Familiarity with CRM systems like HubSpot or Salesforce
  • Knowledge of sales and marketing data use cases
  • Experience with proxy management and crawler scaling
  • Exposure to AI/ML tools in data workflows

What Success Looks Like

  • High-quality, reliable data pipelines supporting business decisions
  • Accurate and clean datasets delivered to stakeholders
  • Strong cross-functional collaboration with sales, marketing, and product teams
  • Scalable and efficient data acquisition systems

Benefits & conditions

Pulled from the full job description

  • 401(k) 4% Match
  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Dental insurance
  • Employee assistance program, * Base Annual Salary: $120,000 - $135,000
  • Annual Bonus: Up to 10%, * Collaborative, inclusive, and innovative work culture
  • Opportunities for learning, growth, and career advancement
  • High-impact role with direct business influence

Why You'll Love Working Here:

  • Attractive Compensation & Performance Bonuses: Enjoy a competitive salary paired with performance-based bonuses
  • Generous PTO: 15 accrued days, plus 10 company holidays annually.
  • Health & Wellness: Comprehensive healthcare, dental, and vision plans for you and your family.
  • Exclusive Perks: Discounts on attractions, theme parks, shows, sports events, movies, hotels, and more through TicketsAtWork.
  • Beauty Perks: $30/month reimbursement for any Vagaro service, including health, beauty, or wellness treatments.
  • Food Perks: $50 monthly stipend for our onsite microkitchen and a complimentary DoorDash DashPass subscription.
  • Growth Opportunities: College Assistance Reimbursement, access to EAP & Work/Life Programs, and a LinkedIn Learning account.
  • Financial Security: 401k program with 4% matching and optional life/supplemental insurance.
  • Stay Active: Access to our on-site gym, flavored water dispenser, and basketball court to keep you fit and energized!

About the company

Why Vagaro? At Vagaro, we believe in fostering a collaborative and inclusive work environment where every team member can thrive. Our culture is built on innovation, continuous learning, and a passion for making a positive impact. We support our employees' growth and vision for themselves, offering opportunities for professional development and career advancement. Join us and be part of a team that values creativity, teamwork, and a commitment to excellence. Plus, we know how to have fun while getting the job done!

Apply for this position