資源簡介
(1)打開豆瓣一部電影評論區,根據html結構捕獲三個信息:
一,每賬號的評分等級為5星、4星、3星、2星、1星;
二,每個賬號的評論留言;
三,跳轉到下個評論頁面的http鏈接
(2)獲取所有的信息后對信息進行處理:
一,計算出每個星級的總數和一共多少賬戶進行了評級
二、將所有的評論內容放在一起,處理評論中的空格和其他不規范形式
(3)用matplotlib繪制評分等級占比的餅圖,用jieba進行分詞處理,用wordcloud生成詞云圖
同個修改url=https://movie.douban.com/subject/26430636/comments?start=0&limit=20&sort=new_score&status=P&percent;_type=
之中“26430636”為電影的代表,將其換做其他的編號就可以讀取和生成其他電影的matplotlib和wordcloud制作評分圖和詞云圖
代碼片段和文件信息
import?requests
from?bs4?import?BeautifulSoup
import?random
import?matplotlib.pyplot?as?plt
import?jieba
from?wordcloud?import?WordCloud
import?PIL
import?numpy?as?np
agents?=?[
????“Mozilla/5.0?(X11;?Ubuntu;?Linux?x86_64;?rv:17.0;?Baiduspider-ads)?Gecko/17.0?Firefox/17.0“
????“Mozilla/5.0?(Linux;?U;?Android?2.3.6;?en-us;?Nexus?S?Build/GRK39F)?AppleWebKit/533.1?(KHTML?like?Gecko)?Version/4.0?Mobile?Safari/533.1“
????“Avant?Browser/1.2.789rel1?(http://www.avantbrowser.com)“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.1;?en-US)?AppleWebKit/532.5?(KHTML?like?Gecko)?Chrome/4.0.249.0?Safari/532.5“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?5.2;?en-US)?AppleWebKit/532.9?(KHTML?like?Gecko)?Chrome/5.0.310.0?Safari/532.9“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?5.1;?en-US)?AppleWebKit/534.7?(KHTML?like?Gecko)?Chrome/7.0.514.0?Safari/534.7“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.0;?en-US)?AppleWebKit/534.14?(KHTML?like?Gecko)?Chrome/9.0.601.0?Safari/534.14“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.1;?en-US)?AppleWebKit/534.14?(KHTML?like?Gecko)?Chrome/10.0.601.0?Safari/534.14“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.1;?en-US)?AppleWebKit/534.20?(KHTML?like?Gecko)?Chrome/11.0.672.2?Safari/534.20“
????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/534.27?(KHTML?like?Gecko)?Chrome/12.0.712.0?Safari/534.27“
????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/535.1?(KHTML?like?Gecko)?Chrome/13.0.782.24?Safari/535.1“
????“Mozilla/5.0?(Windows?NT?6.0)?AppleWebKit/535.2?(KHTML?like?Gecko)?Chrome/15.0.874.120?Safari/535.2“
????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/535.7?(KHTML?like?Gecko)?Chrome/16.0.912.36?Safari/535.7“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.0?x64;?en-US;?rv:1.9pre)?Gecko/2008072421?Minefield/3.0.2pre“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?5.1;?zh-CN;?rv:1.9b4)?Gecko/2008030317?Firefox/3.0b4“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?5.1;?en-US;?rv:1.9.0.10)?Gecko/2009042316?Firefox/3.0.10“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.0;?en-GB;?rv:1.9.0.11)?Gecko/2009060215?Firefox/3.0.11?(.NET?CLR?3.5.30729)“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?6.0;?en-US;?rv:1.9.1.6)?Gecko/20091201?Firefox/3.5.6?GTB5“
????“Mozilla/5.0?(Windows;?U;?Windows?NT?5.1;?tr;?rv:1.9.2.8)?Gecko/20100722?Firefox/3.6.8?(?.NET?CLR?3.5.30729;?.NET4.0E)“
????“Mozilla/5.0?(Windows;?U;?MSIE?6.0;?Windows?NT?5.1;?SV1;?.NET?CLR?2.0.50727;?BIDUBrowser?7.6)“
????“Mozilla/5.0?(Windows?NT?6.3;?WOW64;?Trident/7.0;?rv:11.0)?like?Gecko“
????“Mozilla/5.0?(Windows?NT?6.3;?WOW64;?rv:46.0)?Gecko/20100101?Firefox/46.0“
????“Mozilla/5.0?(Windows?NT?6.3;?WOW64)?AppleWebKit/537.36?(KHTML?like?Gecko)?Chrome/45.0.2454.99?Safari/537.36“
????“Mozilla/5.0?(Windows?NT?6.3;?Win64;?x64;?Trident/7.0;?Touch;?LCJB;?rv:11.0)?like?Gecko“
????“Mozilla/5.0?(Windows?NT?6.1;?rv:2.0.1)?Gecko/20100101?Firefox/4.0.1“
????“Mozilla/5.0?(Windows?NT?6.1;?Win64;?x64;?rv:2.0.1)?Gecko/20100101?Firefox/4.0.1“
????“Mozill
評論
共有 條評論