資源簡介
python 爬蟲全國大部分城市最低氣溫爬取并可視化源碼,會在當前文件目錄下生成一個render,html即為氣溫可視化文件。
代碼片段和文件信息
from?bs4?import?BeautifulSoup
import?requests
import?os
from?pyecharts?import?Geo
data=[]
def?get_temperature(url):
????headers?=?{
????????‘User-Agent‘:?‘Mozilla/5.0?(Windows?NT?10.0;?Win64;?x64)?AppleWebKit/537.36?(KHTML?like?Gecko)?Chrome/63.0.3239.132?Safari/537.36‘
????????‘Upgrade-Insecure-Requests‘:?‘1‘
????????‘Host‘:?‘www.weather.com.cn‘}???????????#?設置頭文件信息
????req?=?requests.get(url?headers=headers)????#?提交requests?get?請求
????content=req.content
????soup?=?BeautifulSoup(content?“lxml“)???????#?用Beautifulsoup?進行解析
????conmid?=?soup.find(‘div‘?class_=‘conMidtab‘)
????conmid2?=?conmid.findAll(‘div‘?class_=‘conMidtab2‘)
????for?x?in?conmid2:
????????tr_list?=?x.find_all(‘tr‘)[2:]
????????for?index?tr?in?enumerate(tr_list):
????????????td_list?=?tr.f
評論
共有 條評論