資源簡介
對于佛山南海鏈家網(wǎng)數(shù)據(jù)按不同鎮(zhèn)街進(jìn)行爬取,有相應(yīng)的代碼和結(jié)果
代碼片段和文件信息
import?requests
import?time
from?bs4?import?BeautifulSoup
import?pandas?as?pd
#設(shè)置列表頁URL的固定部分
url=‘http://fs.lianjia.com/ershoufang/‘
#設(shè)置頁面頁的可變部分
page=(‘pg‘)
#設(shè)定頭文件
headers?=?{‘User-Agent‘:‘Mozilla/5.0?(Windows?NT?6.1)?AppleWebKit/537.11?(KHTML?like?Gecko)?Chrome/23.0.1271.64?Safari/537.11‘
‘Accept‘:‘text/html;q=0.9*/*;q=0.8‘
‘Accept-Charset‘:‘ISO-8859-1utf-8;q=0.7*;q=0.3‘
‘Accept-Encoding‘:‘gzip‘
‘Connection‘:‘close‘
‘Referer‘:‘http://www.baidu.com/link?url=_andhfsjjjKRgEWkj7i9cFmYYGsisrnm2A-TN3XZDQXxvGsM9k9ZZSnikW2Yds4s&wd=&eqid=c3435a7d00006bd600000003582bfd1f‘
}
#設(shè)定需要的小區(qū)
xiaoqu=[“dali1““danzao““guichengbeinanhaiguangchang““guichengdongchengshiguangchang““l(fā)ishui13““qiandenghu““shishan2““xiqiao“]
yema=?[35119323121]
#
?屬性????????????大小?????日期????時間???名稱
-----------?---------??----------?-----??----
?????目錄???????????0??2018-09-03?10:48??房地產(chǎn)\
?????文件???????19650??2018-08-31?10:47??房地產(chǎn)\dali1.csv
?????文件???????27097??2018-08-31?10:50??房地產(chǎn)\danzao.csv
?????文件???????68741??2018-08-31?10:52??房地產(chǎn)\guichengbeinanhaiguangchang.csv
?????文件???????42660??2018-08-31?17:17??房地產(chǎn)\guichengdongchengshiguangchang.csv
?????文件????????2691??2018-08-31?10:44??房地產(chǎn)\lianjia.py
?????文件???????16117??2018-08-31?10:55??房地產(chǎn)\lishui13.csv
?????文件??????146872??2018-08-31?11:01??房地產(chǎn)\qiandenghu.csv
?????文件???????56832??2018-08-31?11:09??房地產(chǎn)\shishan2.csv
?????文件????????2286??2018-08-31?11:05??房地產(chǎn)\xiqiao.csv
?????文件???????12625??2018-08-31?17:17??房地產(chǎn)\街道房價.csv
評論
共有 條評論