資源簡介
一個微博爬蟲程序(對github做的二次開發),擴展了統計用戶高頻詞生成詞云圖,以及文本輸入欄等...
運行前請確認環境配置無誤,有問題可聯系我
代碼片段和文件信息
import?codecs
import?csv
import?json
import?math
import?os
import?random
import?sys
import?traceback
from?collections?import?OrderedDict
from?datetime?import?datetime?timedelta
from?time?import?sleep
import?requests
from?lxml?import?etree
from?requests.adapters?import?HTTPAdapter
from?tqdm?import?tqdm
class?Weibo(object):
????def?__init__(self
?????????????????filter=0
?????????????????since_date=‘1900-01-01‘
?????????????????mysql_write=0
?????????????????pic_download=0
?????????????????video_download=0):
????????“““Weibo類初始化“““
????????if?filter?!=?0?and?filter?!=?1:
????????????sys.exit(u‘filter值應為數字0或1請重新輸入‘)
????????if?not?self.is_date(since_date):
????????????sys.exit(u‘since_date值應為yyyy-mm-dd形式請重新輸入‘)
????????if?mysql_write?!=?0?and?mysql_w
?屬性????????????大小?????日期????時間???名稱
-----------?---------??----------?-----??----
?????文件??????240249??2019-11-25?13:38??love.png
?????文件???????32578??2019-11-25?15:11??main.py
?????目錄???????????0??2020-02-24?21:53??weibo\
?????文件?????????791??2019-11-25?14:40??wordcolud.py
- 上一篇:用Python寫網絡爬蟲(共35頁)
- 下一篇:Django用戶注冊
評論
共有 條評論