Tech Talk: Scraping The Internet At Scale – Seeing the internet through the eyes of an LLM
Join 100state member Matt Lea on Zoom as he demonstrates a few of the techniques and technologies used to scrape the internet for data at scale.
This includes using LLM models to assist in the scraping process by deciphering patterns, classifying pages, and pre-processing/embedding data before it gets saved.
As always group participation is welcome. Feel free to share your adventures scraping the internet.
This event is free but registration is required through Lu.ma is required.
We’re excited to support Matt in his ongoing series of Tech Talks and virtual events that bring fresh insights to the tech community.
For daily tech tips follow Matt on Linkedin
