Pixiv爬虫 爬取每日排行榜
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Go to file
nyaasuki bd67592f2b
Merge pull request #4 from nyaasuki/revert-2-dev
2 years ago
.gitignore Revert "Dev" 2 years ago
LICENSE 添加 LICENSE 4 years ago
Pixiv.py Revert "Dev" 2 years ago
README.md Revert "Dev" 2 years ago
requirements.txt Revert "Dev" 2 years ago

README.md

This file contains invisible Unicode characters!

This file contains invisible Unicode characters that may be processed differently from what appears below. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to reveal hidden characters.

This file contains ambiguous Unicode characters that may be confused with others in your current locale. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to highlight these characters.

一个Pixiv小爬虫目前只可以爬每日 支持长时间爬取 跳过已经爬过的

环境需求

Python:3.6+ / Redis

食用方法

Linux/OSX:

git clone https://github.com/nyaasuki/PixivSpider.git && cd ./PixivSpider
python3 Pixiv.py

Windows:

  1. 下载/clone这个项目

  2. 配置好环境python、Redis

  3. 打开你的CMD窗口

  4. 输入python+ ←这是一个空格

  5. 用鼠标把Pixiv.py这个文件拖到cmd窗口

    ^_^

注意事项

1.requests安装错误

ERROR: Could not find a version that satisfies the requirement resquests ERROR: No matching distribution found for resquests

解决方案手动安装requests

'pip install -i https://pypi.tuna.tsinghua.edu.cn/simple requests'

2.请输入一个cookie

目前此项留空直接回车也可以正常爬取,如果后续添加新功能可以能需要

此项储存在本地redis中

特别提醒

正常来说,当没有出现上方问题时,程序出现问题大多为你的上网方式不够科学 缓慢更新中...