1200字范文,内容丰富有趣,写作的好帮手!
1200字范文 > Python爬虫实战 requests模块 Python实现抓取王者荣耀全套皮肤

Python爬虫实战 requests模块 Python实现抓取王者荣耀全套皮肤

时间:2019-01-08 16:27:00

相关推荐

Python爬虫实战 requests模块 Python实现抓取王者荣耀全套皮肤

开发工具

Python版本:3.6.4

相关模块:

requests模块;

urllib模块;

以及一些Python自带的模块。

环境搭建

安装Python并添加到环境变量,pip安装需要的相关模块即可。

思路分析

1、打开官方王者荣耀壁纸网站 网站地址:/web05/w…

2、快捷键F12,调出控制台进行抓包

3、找到正确的链接并分析

4、查看返回数据格式

5、解析url链接

6、查看url内容是否是所需图片,发现其实是缩略图

7、那就去分析网站,随便点开一张壁纸,查看指定格式的链接

8、找到目标地址

9、分析目标链接和缩略图的链接区别

缩略图:/ishow/2735090714/1599460171_84828260_8311_sProdImgNo_6.jpg/200目标图:/ishow/2735090714/1599460171_84828260_8311_sProdImgNo_6.jpg/0复制代码

可以知道,将指定格式的缩略图地址后面200替换成0就是目标真实图片

代码实现

import os, time, requests, json, refrom retrying import retryfrom urllib import parseclass HonorOfKings:'''This is a main Class, the file contains all documents.One document contains paragraphs that have several sentencesIt loads the original file and converts the original file to new contentThen the new content will be saved by this class'''def __init__(self, save_path='./heros'):self.save_path = save_pathself.time = str(time.time()).split('.')self.url = 'https://apps./cgi-bin/ams/module/ishow/V1.0/query/workList_inc.cgi?activityId=2735&sVerifyCode=ABCD&sDataType=JSON&iListNum=20&totalpage=0&page={}&iOrder=0&iSortNumClose=1&iAMSActivityId=51991&_everyRead=true&iTypeId=2&iFlowId=267733&iActId=2735&iModuleId=2735&_=%s' % self.time[0]def hello(self):'''This is a welcome speech:return: self'''print("*" * 50)print(' ' * 18 + '王者荣耀壁纸下载')print(' ' * 5 + '作者: Felix Date: -05-20 13:14')print("*" * 50)return selfdef run(self):'''The program entry'''print('↓' * 20 + ' 格式选择: ' + '↓' * 20)print('1.缩略图 2.1024x768 3.1280x720 4.1280x1024 5.1440x900 6.1920x1080 7.1920x1200 8.1920x1440')size = input('请输入您想下载的格式序号,默认6:')size = size if size and int(size) in [1,2,3,4,5,6,7,8] else 6print('---下载开始...')page = 0offset = 0total_response = self.request(self.url.format(page)).texttotal_res = json.loads(total_response)total_page = --int(total_res['iTotalPages'])print('---总共 {} 页...' . format(total_page))while True:if offset > total_page:breakurl = self.url.format(offset)response = self.request(url).textresult = json.loads(response)now = 0for item in result["List"]:now += 1hero_name = parse.unquote(item['sProdName']).split('-')[0]hero_name = re.sub(r'[【】:.<>|·@#$%^&() ]', '', hero_name)print('---正在下载第 {} 页 {} 英雄 进度{}/{}...' . format(offset, hero_name, now, len(result["List"])))hero_url = parse.unquote(item['sProdImgNo_{}'.format(str(size))])save_path = self.save_path + '/' + hero_namesave_name = save_path + '/' + hero_url.split('/')[-2]if not os.path.exists(save_path):os.makedirs(save_path)if not os.path.exists(save_name):with open(save_name, 'wb') as f:response_content = self.request(hero_url.replace("/200", "/0")).contentf.write(response_content)offset += 1print('---下载完成...')@retry(stop_max_attempt_number=3)def request(self, url):'''Send a request:param url: the url of request:param timeout: the time of request:return: the result of request'''response = requests.get(url, timeout=10)assert response.status_code == 200return responseif __name__ == "__main__":HonorOfKings().hello().run()复制代码

本期完整源代码详见个人主页简介获取

代码运行结果

本内容不代表本网观点和政治立场,如有侵犯你的权益请联系我们处理。
网友评论
网友评论仅供其表达个人看法,并不表明网站立场。