百度图片爬虫
- 直接运行
python setup.py --keywords=古风 --folder=/User/puke/Document --limit=0
keywords
: 搜索关键词, 多个关键词用"-"分割folder
: 图片保存路径, 文件夹不存在时会自动创建limit
: 搜索图片的页数限制, 正数表示爬取limit页图片, 0表示爬取所有图片
以古风
为关键词,爬的效果如下
还有json
、text
、markdown
形式的导出,如下
json
{
"fromPageTitle": "<strong>古风</strong>美男 **风 手绘",
"thumbURL": "http://img0.imgtn.bdimg.com/it/u=318340784,2667811132&fm=27&gp=0.jpg",
"objURL": "http://img5q.duitang.com/uploads/item/201506/08/20150608192332_XLm5C.jpeg"
},
{
"fromPageTitle": "充满<strong>古风</strong>意蕴的散散之笔, 细致入微的人物刻画 带你走进一个全新古典",
"thumbURL": "http://img5.imgtn.bdimg.com/it/u=2673515744,2774212201&fm=27&gp=0.jpg",
"objURL": "http://img1.3lian.com/2015/a1/54/d/52.jpg"
},
{
"fromPageTitle": "<strong>古风</strong>",
"thumbURL": "http://img3.imgtn.bdimg.com/it/u=527217728,2884200961&fm=27&gp=0.jpg",
"objURL": "http://img5.duitang.com/uploads/blog/201405/24/20140524150831_kTJEA.thumb.700_0.jpeg"
}
text
fromPageTitle : <strong>古风</strong>
thumbURL : http://img5.imgtn.bdimg.com/it/u=1822799899,152357902&fm=27&gp=0.jpg
objURL : http://cdn.duitang.com/uploads/item/201601/03/20160103203235_yfwtL.thumb.700_0.jpeg
fromPageTitle : 求<strong>古风</strong>的动漫图
thumbURL : http://img5.imgtn.bdimg.com/it/u=363594260,3917306499&fm=27&gp=0.jpg
objURL : http://c.hiphotos.baidu.com/zhidao/pic/item/9d82d158ccbf6c81921e8b90ba3eb13533fa4098.jpg
fromPageTitle : <strong>古风</strong>头像 醉生梦死烟花烫
thumbURL : http://img5.imgtn.bdimg.com/it/u=356411596,2828866357&fm=27&gp=0.jpg
objURL : http://img4.duitang.com/uploads/item/201509/17/20150917121843_hQjJU.jpeg
markdown
[<strong>古风</strong>美男 **风 手绘](http://img5q.duitang.com/uploads/item/201506/08/20150608192332_XLm5C.jpeg)
![](http://img0.imgtn.bdimg.com/it/u=318340784,2667811132&fm=27&gp=0.jpg)
[充满<strong>古风</strong>意蕴的散散之笔, 细致入微的人物刻画 带你走进一个全新古典](http://img1.3lian.com/2015/a1/54/d/52.jpg)
![](http://img5.imgtn.bdimg.com/it/u=2673515744,2774212201&fm=27&gp=0.jpg)
[<strong>古风</strong>](http://img5.duitang.com/uploads/blog/201405/24/20140524150831_kTJEA.thumb.700_0.jpeg)
![](http://img3.imgtn.bdimg.com/it/u=527217728,2884200961&fm=27&gp=0.jpg)