Web Scraping: Crawling Linkedin Profiles

Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Tutorial:

• English: https://youtu.be/zkfLAY2OrtI
• Vietnamese: https://youtu.be/hfnBswCe4QE

Problem:

It takes 10s on average to skim through Linkedin profiles and copy that information into an excel sheet. To collect a large enough amount of data for analysis purposes, it will take time if done manually.

Approach to the problem:

To efficiently collect and cluster Linkedin profiles data, this scrip helps automatically scrape the web data of people profiles on Linkedin based on a specific search query and store the output in a CSV file

Sponsor

Scrape public LinkedIn profile data at scale with Proxycurl APIs.

• Scraping Public profiles are battle tested in court in HiQ VS LinkedIn case.
• GDPR, CCPA, SOC2 compliant
• High rate Limit - 300 requests/minute
• Fast APIs respond in ~2s
• Fresh data - 88% of data is scraped real-time, other 12% are not older than 29 days
• High accuracy
• Tons of data points returned per profile

Built for developers, by developers.