The Ultimate Web Scraping Course

Here's what you'll get

In the course I show you how to scrape these sites (and give you the code)

Instagram

Twitter

Tiktok

Linkedin

Zillow

Google Search

Google Maps

Amazon

Indeed

ESPN

Angi List

And more!

I'll also show you how I have gotten clients, and how I've gotten my 25k+ followers on social media (and how you can too)

What's Inside

9 hours of videos

Is web scraping legal?

Scrapers vs Hackers

All the services I use (proxies, coding language, servers, database, packages to get around getting blocked)

How websites get their data (how API's work)

My process for scraping ANY site

How to find where data is coming from

How to avoid getting blocked

All about proxies

Scraping by web framework (React, Next.js, static HTML/server rendered, ASP.NET, Java)

How to reverse engineer sites with good blocking

Scraping sites with Cursor Based Pagination (YouTube comments)

Scraping a chrome extension for free emails

How to scrape mobile apps

How to skip trace (find random people's phone numbers and emails)

How to get Puppeteer running on AWS Lambda

How to intercept requests with Puppeteer

Solving captchas with Puppeteer

How to get web scraping clients

How to charge clients

Product ideas that rely on web scraping

Disclaimers

The code is in JavaScript and I am using a Mac with VS Code editor

I only briefly talk about Puppeteer (there are MUCH better ways)

If you are dissatisfied at all with the content, I will give you 100% refund (contact me at adrian@thewebscrapingguy.com)

Scraping isn't magic ? you do have to have a source to scrape (a website). Like you can't scrape people's bank accounts or something. That would be more hacking, which is a different field.

Prerequisites

You should have a good understanding of JavaScript, or some programming language, to get the most out of this course.

If you don't know how to code at all, this is not the course for you.

I don't teach the basics of coding or JavaScript in this course.


More info