Data Engineer, Data Acquisition (Web Crawling & Pipelines)
Vagaro, Inc.
Pleasanton, United States of America
15 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Intermediate Compensation
$ 135KJob location
Pleasanton, United States of America
Tech stack
JavaScript
API
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Big Data
Computer Programming
Databases
Data Cleansing
Data Deduplication
Information Engineering
ETL
Data Transformation
Distributed Systems
Python
Salesforce
Selenium
SQL Databases
Unstructured Data
Web Crawlers
Google Cloud Platform
Build Management
Playwright
Dynamic Content
Machine Learning Operations
Hubspot
Pagination
Data Pipelines
Job description
We are seeking a Data Acquisition Engineer to design, build, and scale systems that collect, process, and maintain high-quality external data from the web and third-party sources., * Design and build scalable web crawlers and scraping systems to extract structured and unstructured data
- Collect data from websites, APIs, and databases to support sales and marketing initiatives
- Handle dynamic content, pagination, and JavaScript-heavy sites
- Perform data cleaning, preprocessing, and validation to ensure accuracy and usability
- Deliver clean, structured datasets aligned to business requirements
- Collaborate with sales, marketing, and product teams to align data efforts with business goals
- Optimize pipelines for performance, scalability, and reliability
- Ensure ethical, compliant data collection practices
Data Engineering & Infrastructure
- Build ETL/ELT pipelines for ingestion, transformation, and storage
- Implement schema design, deduplication, and change detection
- Manage orchestration tools (Airflow, Prefect, etc.)
- Work with cloud platforms (AWS, GCP, Azure) and databases
Requirements
Do you have experience in SQL?, * 3+ years of experience in web crawling, scraping, or data engineering
- Strong programming skills in Python or JavaScript
- Experience with tools like Scrapy, BeautifulSoup, Selenium, or Playwright
- Understanding of HTTP, DOM parsing, and web architectures
- Strong data cleaning and preprocessing skills
- Proficiency in SQL and working with databases
- Strong problem-solving skills and attention to detail
- Excellent written and verbal communication skills, * Experience with distributed systems or large-scale data processing
- Familiarity with CRM systems like HubSpot or Salesforce
- Knowledge of sales and marketing data use cases
- Experience with proxy management and crawler scaling
- Exposure to AI/ML tools in data workflows
What Success Looks Like
- High-quality, reliable data pipelines supporting business decisions
- Accurate and clean datasets delivered to stakeholders
- Strong cross-functional collaboration with sales, marketing, and product teams
- Scalable and efficient data acquisition systems
Benefits & conditions
Pulled from the full job description
- 401(k) 4% Match
- Health insurance
- 401(k) matching
- Paid time off
- Vision insurance
- Dental insurance
- Employee assistance program, * Base Annual Salary: $120,000 - $135,000
- Annual Bonus: Up to 10%, * Collaborative, inclusive, and innovative work culture
- Opportunities for learning, growth, and career advancement
- High-impact role with direct business influence
Why You'll Love Working Here:
- Attractive Compensation & Performance Bonuses: Enjoy a competitive salary paired with performance-based bonuses
- Generous PTO: 15 accrued days, plus 10 company holidays annually.
- Health & Wellness: Comprehensive healthcare, dental, and vision plans for you and your family.
- Exclusive Perks: Discounts on attractions, theme parks, shows, sports events, movies, hotels, and more through TicketsAtWork.
- Beauty Perks: $30/month reimbursement for any Vagaro service, including health, beauty, or wellness treatments.
- Food Perks: $50 monthly stipend for our onsite microkitchen and a complimentary DoorDash DashPass subscription.
- Growth Opportunities: College Assistance Reimbursement, access to EAP & Work/Life Programs, and a LinkedIn Learning account.
- Financial Security: 401k program with 4% matching and optional life/supplemental insurance.
- Stay Active: Access to our on-site gym, flavored water dispenser, and basketball court to keep you fit and energized!
About the company
Why Vagaro? At Vagaro, we believe in fostering a collaborative and inclusive work environment where every team member can thrive. Our culture is built on innovation, continuous learning, and a passion for making a positive impact. We support our employees' growth and vision for themselves, offering opportunities for professional development and career advancement. Join us and be part of a team that values creativity, teamwork, and a commitment to excellence. Plus, we know how to have fun while getting the job done!