爬虫绕过cloudflare验证

2023-09-26 21:35:58

换另外一个python库：cloudflare-scrape

pip install cfscrape

import cfscrape

scraper = cfscrape.create_scraper()  # returns a CloudflareScraper instance
# Or: scraper = cfscrape.CloudflareScraper()  # CloudflareScraper inherits from requests.Session
print(scraper.get("http://...",headers={‘user-agent‘:‘...‘}).text)  # => "<!DOCTYPE html><html><head>..."

tip：

支持的Python版本：2.6 - 3.7
需要nodejs环境
- 安装nodejs：https://www.cnblogs.com/jiyu-hlzy/p/12209337.html

爬虫绕过cloudflare验证