WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
JavaScript Congress • Nov 25, 2021

Automate everything via NodeJS and Puppeteer

Miki Lombardi

Stop wasting development hours on manual UI tasks. Master Node.js and Puppeteer to automate everything from resilient web scraping to continuous performance monitoring.

Pause
Mute Enter Fullscreen
#1 about 3 min

Understanding Puppeteer and its underlying architectural design

How Puppeteer wraps Chrome APIs to control headless browser instances via the DevTools protocol.

#2 about 3 min

Evolution of web automation from Selenium to Puppeteer

The evolution of web testing tools transitioning from Selenium to PhantomJS and modern JavaScript alternatives.

#3 about 2 min

Writing and structuring NodeJS browser automation scripts

Executing basic browser navigation and sequential interactions while maintaining modular automation code.

#4 about 2 min

Core use cases for headless browser automation tools

Applying browser APIs for common tasks like web scraping, PDF generation, UI testing, and performance profiling.

#5 about 3 min

Comparing Puppeteer with Playwright and Selenium frameworks

Evaluating modern browser automation libraries based on cross-browser support capabilities and parallel end-to-end testing features.

#6 about 4 min

Implementing automated UI tests with Jest and Puppeteer

Integrating browser assertions and programmatic regression testing into standard testing frameworks like Jest.

#7 about 7 min

Scraping web data by intercepting JSON HTTP responses

Building a modular web scraping utility to extract target data directly by intercepting JSON HTTP responses.

#8 about 5 min

Automating manual web workflows using GitHub Actions

Using headless browsers in continuous integration pipelines to automate multi-step web forms and manual file uploads.

#9 about 5 min

Automating frontend performance metrics with Google Lighthouse

Running automated accessibility and performance checks aggregated into interactive Prometheus and Grafana dashboards.

#10 about 3 min

Containerizing Puppeteer and Chromium within Docker environments

Configuring Alpine Linux and specific environment variables to reliably run headless browsers inside lightweight system containers.

#11 about 2 min

Evaluating workflow efficiency logic and open source contributions

Balancing the upfront effort of creating automation scripts against long-term development time savings and workflow efficiency.

#12 about 4 min

Choosing between Puppeteer and Cypress for browser tasks

Deciding whether to use general-purpose automation logic versus dedicated testing frameworks for component verification workflows.

#13 about 3 min

Running Puppeteer in serverless cloud environments and AWS

Addressing the inherent resource challenges and cold-start times of managing headless browser dependencies on cloud computing infrastructure.

#14 about 2 min

Determining when to start automating repetitive manual tasks

Personal philosophies detailing how to balance the upfront scripting effort against the burden of ongoing manual repetition.

Matching moments

4:12 min

Leveraging modern languages and browser libraries for automation

Chris Heilmann +4 · LIVE

1:57 min

Demonstrating web data collection using JavaScript browser automation libraries

Tim Ruscica · Coffee With Developers

1:01 min

Introduction to the speaker and visual testing journey

Ramona Schwering Ramona Schwering · LIVE

2:34 min

Bridging visual language models with browser automation frameworks

Andrei Nutas Andrei Nutas · World Congress 2026 Europe

2:13 min

Automating scoped accessibility tests with Playwright

Jörg Jakoby Jörg Jakoby · World Congress 2026 Europe

3:31 min

Automating complex browser workflows with artificial intelligence testing frameworks

Dan Cranney +2 · LIVE

More from JavaScript Congress

The Eternal Sunshine of the Zero Build Pipeline thumbnail
50:10
almost 5 years ago

The Eternal Sunshine of the Zero Build Pipeline

Teini - an extremely small webshop leveraging awesome and free tech thumbnail
40:45
almost 5 years ago

Teini - an extremely small webshop leveraging awesome and free tech

Christian K

Native Web Apps: Are We There Yet? thumbnail
44:40
almost 5 years ago

Native Web Apps: Are We There Yet?

Maxim Salnikov

Modern Web Development with Nuxt3 thumbnail
41:43
almost 5 years ago

Modern Web Development with Nuxt3

Alexander Lichter

Making neural networks portable with ONNX thumbnail
54:49
almost 5 years ago

Making neural networks portable with ONNX

Ron Dagdag

JavaScript the Grumpy Parts thumbnail
46:08
almost 5 years ago

JavaScript the Grumpy Parts

Rob Richardson

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 23, 2026 · 13:00–13:30

Stage 2

Parallelize Your Development with GitHub Copilot

Pamela Fox

Principal Cloud Advocate, Microsoft

Pamela Fox
Open session

World Congress 2026 North America

September 24, 2026 · 10:20–10:50

Stage 6

Practices, Not Prompts: Scale GitHub Copilot with AI-Ready Repositories

Luis Pujols

Staff Customer Success Architect, GitHub

Luis Pujols
Open session

World Congress 2026 North America

September 25, 2026 · 15:30–16:00

Stage 6

Small LLM in your Browser: Huge Opportunities for Web Applications

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 6

Accelerating development and managing agents with the GitHub Copilot app

Christopher Harrison

Senior Developer Advocate at GitHub

Christopher Harrison
Open session

World Congress 2026 North America

September 23, 2026 · 15:40–16:10

Stage 2

Lean Intelligence: Lessons from GitHub Copilot Data Science Efforts

Rahul Pandita

Researcher and Technical Advisor at Microsoft

Rahul Pandita
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Stage 6

Going beyond the code through the GitHub Copilot App: how to unlock you and your team’s superpower

Jenny Hwang

Director of User Research at GitHub

Jenny Hwang

Related videos

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
LIVE • 2 months ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA thumbnail
26:39
World Congress 2026 Europe • 2 months ago

Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA

Andrei Nutas

From clicks to cribs - How to find your dream home with web scraping thumbnail
26:08
World Congress 2023 • almost 3 years ago

From clicks to cribs - How to find your dream home with web scraping

Alexander Lichter

Measure and improve frontend performance by using test automation thumbnail
25:38
World Congress 2023 • almost 3 years ago

Measure and improve frontend performance by using test automation

Ramona Schwering

How to scrape modern websites to feed AI agents thumbnail
19:20
World Congress 2025 • about 1 year ago

How to scrape modern websites to feed AI agents

Jan Curn

The Journey of a Pixel in a React Application thumbnail
27:01
World Congress 2025 • about 1 year ago

The Journey of a Pixel in a React Application

Shem Magnezi

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.