WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
JavaScript Congress • Nov 25, 2021

Automate everything via NodeJS and Puppeteer

Miki Lombardi

Stop wasting development hours on manual UI tasks. Master Node.js and Puppeteer to automate everything from resilient web scraping to continuous performance monitoring.

Pause
Mute Enter Fullscreen
#1 about 3 min

Understanding Puppeteer and its underlying architectural design

How Puppeteer wraps Chrome APIs to control headless browser instances via the DevTools protocol.

#2 about 3 min

Evolution of web automation from Selenium to Puppeteer

The evolution of web testing tools transitioning from Selenium to PhantomJS and modern JavaScript alternatives.

#3 about 2 min

Writing and structuring NodeJS browser automation scripts

Executing basic browser navigation and sequential interactions while maintaining modular automation code.

#4 about 2 min

Core use cases for headless browser automation tools

Applying browser APIs for common tasks like web scraping, PDF generation, UI testing, and performance profiling.

#5 about 3 min

Comparing Puppeteer with Playwright and Selenium frameworks

Evaluating modern browser automation libraries based on cross-browser support capabilities and parallel end-to-end testing features.

#6 about 4 min

Implementing automated UI tests with Jest and Puppeteer

Integrating browser assertions and programmatic regression testing into standard testing frameworks like Jest.

#7 about 7 min

Scraping web data by intercepting JSON HTTP responses

Building a modular web scraping utility to extract target data directly by intercepting JSON HTTP responses.

#8 about 5 min

Automating manual web workflows using GitHub Actions

Using headless browsers in continuous integration pipelines to automate multi-step web forms and manual file uploads.

#9 about 5 min

Automating frontend performance metrics with Google Lighthouse

Running automated accessibility and performance checks aggregated into interactive Prometheus and Grafana dashboards.

#10 about 3 min

Containerizing Puppeteer and Chromium within Docker environments

Configuring Alpine Linux and specific environment variables to reliably run headless browsers inside lightweight system containers.

#11 about 2 min

Evaluating workflow efficiency logic and open source contributions

Balancing the upfront effort of creating automation scripts against long-term development time savings and workflow efficiency.

#12 about 4 min

Choosing between Puppeteer and Cypress for browser tasks

Deciding whether to use general-purpose automation logic versus dedicated testing frameworks for component verification workflows.

#13 about 3 min

Running Puppeteer in serverless cloud environments and AWS

Addressing the inherent resource challenges and cold-start times of managing headless browser dependencies on cloud computing infrastructure.

#14 about 2 min

Determining when to start automating repetitive manual tasks

Personal philosophies detailing how to balance the upfront scripting effort against the burden of ongoing manual repetition.

Matching moments

4:12 min

Leveraging modern languages and browser libraries for automation

Chris Heilmann +4 · LIVE

1:57 min

Demonstrating web data collection using JavaScript browser automation libraries

Tim Ruscica · Coffee With Developers

1:01 min

Introduction to the speaker and visual testing journey

Ramona Schwering Ramona Schwering · LIVE

2:34 min

Bridging visual language models with browser automation frameworks

Andrei Nutas Andrei Nutas · WWC Europe 2026

2:13 min

Automating scoped accessibility tests with Playwright

Jörg Jakoby Jörg Jakoby · WWC Europe 2026

3:31 min

Automating complex browser workflows with artificial intelligence testing frameworks

Dan Cranney +2 · LIVE

More from JavaScript Congress

The Eternal Sunshine of the Zero Build Pipeline thumbnail
50:10
over 4 years ago

The Eternal Sunshine of the Zero Build Pipeline

Teini - an extremely small webshop leveraging awesome and free tech thumbnail
40:45
over 4 years ago

Teini - an extremely small webshop leveraging awesome and free tech

Christian K

Native Web Apps: Are We There Yet? thumbnail
44:40
over 4 years ago

Native Web Apps: Are We There Yet?

Maxim Salnikov

Modern Web Development with Nuxt3 thumbnail
41:43
over 4 years ago

Modern Web Development with Nuxt3

Alexander Lichter

Making neural networks portable with ONNX thumbnail
54:49
over 4 years ago

Making neural networks portable with ONNX

Ron Dagdag

JavaScript the Grumpy Parts thumbnail
46:08
over 4 years ago

JavaScript the Grumpy Parts

Rob Richardson

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Small LLM in your Browser: Huge Opportunities for Web Applications

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

Fast by Design: A Masterclass in High-Performance Web Engineering

Aaron Grogg

Senior web developer, committed to improving the user experience by improving web performance

Aaron Grogg
Open session

World Congress 2026 North America

It’s Alive! Taming the MLOps Franken-Stack: Write, Run, and Serve with Michelangelo

Eric Wang, Paul Zimmerman

Eric Wang
Paul Zimmerman
Open session

World Congress 2026 North America

GitHub’s Team X-Ray: Your Repository Knows More About Your Team Than Your Team Does

Andrea Griffiths

Senior Developer Advocate

Andrea Griffiths
Open session

World Congress 2026 North America

How to generate business value through performance optimizations

Nikolai Sidiropulo

Software Engineer at Meta

Nikolai Sidiropulo
Open session

World Congress 2026 North America

One Repo, One Strategy: Scalable Full-Stack Testing in a Monorepo World

Paweł Matynia, Bartosz Leczycki

Paweł Matynia
Bartosz Leczycki

Related videos

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
LIVE • 26 days ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA thumbnail
26:39
WWC Europe 2026 • about 1 month ago

Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA

Andrei Nutas

From clicks to cribs - How to find your dream home with web scraping thumbnail
26:08
WWC 2023 • almost 3 years ago

From clicks to cribs - How to find your dream home with web scraping

Alexander Lichter

Measure and improve frontend performance by using test automation thumbnail
25:38
WWC 2023 • almost 3 years ago

Measure and improve frontend performance by using test automation

Ramona Schwering

How to scrape modern websites to feed AI agents thumbnail
19:20
WWC 2025 • 12 months ago

How to scrape modern websites to feed AI agents

Jan Curn

The Journey of a Pixel in a React Application thumbnail
27:01
WWC 2025 • 12 months ago

The Journey of a Pixel in a React Application

Shem Magnezi

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.