資源簡介
爬取企查查網站上公司的工商信息,路徑大家根據自己情況自行修改,然后再在工程路徑下創建個company.txt,里面輸入想要爬取的公司名,就會生成該公司的工商信息網頁。
代碼片段和文件信息
#?-*-?coding-8?-*-
import?requests
import?lxml
from?bs4?import?BeautifulSoup
import?xlwt
import?re
import?urllib
import?random
import?sys
import?io
sys.stdout?=?io.TextIOWrapper(sys.stdout.bufferencoding=‘utf8‘)?#改變標準輸出的默認編碼
def?get_user_agent():
????user_agent_list?=?[
????????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/537.1?(KHTML?like?Gecko)?Chrome/22.0.1207.1?Safari/537.1“
????????“Mozilla/5.0?(X11;?CrOS?i686?2268.111.0)?AppleWebKit/536.11?(KHTML?like?Gecko)?Chrome/20.0.1132.57?Safari/536.11“
????????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/536.6?(KHTML?like?Gecko)?Chrome/20.0.1092.0?Safari/536.6“
????????“Mozilla/5.0?(Windows?NT?6.2)?AppleWebKit/536.6?(KHTML?like?Gecko)?Chrome/20.0.1090.0?Safari/536.6“
????????“Mozilla/5.0?(Windows?NT?6.2;?WOW64)?AppleWebKit/537.1?(KHTML?like?Gecko)?Chrome/19.77.34.5?Safari/537.1“
????????“Mozilla/5.0?(X11;?Linux?x86_64)?AppleWebKit/536.5?(KHTML?like?Gecko)?Chrome/19.0.1084.9?Safari/536.5“
????????“Mozilla/5.0?(Windows?NT?6.0)?AppleWebKit/536.5?(KHTML?like?Gecko)?Chrome/19.0.1084.36?Safari/536.5“
????????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1063.0?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?5.1)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1063.0?Safari/536.3“
????????“Mozilla/5.0?(Macintosh;?Intel?Mac?OS?X?10_8_0)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1063.0?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?6.2)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1062.0?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1062.0?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?6.2)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1061.1?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?6.1;?WOW64)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1061.1?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?6.1)?AppleWebKit/536.3?(KHTML?like?Gecko)?Chrome/19.0.1061.1?Safari/536.3“
????????“Mozilla/5.0?(Windows?NT?6.2)?AppleWebKit/536.3?(KHTML?like
評論
共有 條評論