資源簡介
爬取豌豆莢APP,將APP信息存儲到數據庫,APP以md5值命名,
代碼片段和文件信息
#coding?utf-8
import?crawler
def?ch_update():
????update_file?=?‘log_file/update.txt‘
????crawer?=?crawler.Crawler(‘http://www.wandoujia.com/category/app‘update_file)
????crawer.crow()
????past?=?open(‘log_file/urls.txt‘‘r‘)
????now?=?open(‘log_file/update.txt‘‘r‘)
????past_list?=?past.readlines()
????now_list?=?now.readlines()
????if?len(now_list)>len(past_list):
????????past.close()
????????now.close()
????????print?u‘有更新‘
????????return?True
????else:
????????past.close()
????????now.close()
????????print?u‘沒有更新‘
????????return?False
????????
????????????
????
????
?屬性????????????大小?????日期????時間???名稱
-----------?---------??----------?-----??----
?????文件?????165888??2016-09-14?11:53??安卓應用爬蟲\apk_information.db
?????文件????????623??2016-09-11?13:06??安卓應用爬蟲\check_update.py
?????文件????????780??2016-09-11?14:58??安卓應用爬蟲\check_update.pyc
?????文件???????1789??2016-09-11?16:23??安卓應用爬蟲\context.py
?????文件???????1774??2016-09-11?16:23??安卓應用爬蟲\context.pyc
?????文件???????5796??2016-09-11?15:24??安卓應用爬蟲\crawler.py
?????文件???????4489??2016-09-11?15:25??安卓應用爬蟲\crawler.pyc
?????文件???????1442??2016-09-13?12:43??安卓應用爬蟲\databa
?????文件???????2262??2016-09-13?12:46??安卓應用爬蟲\databa
?????文件????????795??2016-09-11?22:27??安卓應用爬蟲\downjudge.py
?????文件????????892??2016-09-11?22:27??安卓應用爬蟲\downjudge.pyc
?????文件???????1616??2016-09-11?22:09??安卓應用爬蟲\download.py
?????文件???????1743??2016-09-11?22:24??安卓應用爬蟲\download.pyc
?????文件????????266??2016-09-02?16:54??安卓應用爬蟲\hash_md5.py
?????文件????????535??2016-09-02?16:59??安卓應用爬蟲\hash_md5.pyc
?????文件????????297??2016-09-18?21:28??安卓應用爬蟲\log_file\downed.txt
?????文件???????7143??2016-09-11?15:22??安卓應用爬蟲\log_file\failurls.txt
?????文件?????102532??2016-09-11?15:19??安卓應用爬蟲\log_file\log.txt
?????文件????1699963??2016-09-11?15:22??安卓應用爬蟲\log_file\urls.txt
?????文件???????4377??2016-09-13?12:36??安卓應用爬蟲\main.py
?????文件?????????84??2016-09-18?20:46??安卓應用爬蟲\test.py
?????目錄??????????0??2016-09-22?15:47??安卓應用爬蟲\apk_files
?????目錄??????????0??2016-09-14?12:03??安卓應用爬蟲\log_file
?????目錄??????????0??2016-09-18?20:44??安卓應用爬蟲
-----------?---------??----------?-----??----
??????????????2005086????????????????????24
- 上一篇:python 微信機器人 源碼
- 下一篇:python3爬蟲采集淘寶商品數據
評論
共有 條評論