Wallpaper scraper/grabber for a certain website...
0323ddbed8
On keyboard interrupt in the regular flow of downloading the collected images of this session and of last session are saved so as not to destroy the archive accidentally this way. If an item is added to the new collection, it is removed from the old one. If a save is being dumped (uncleanly saved because of KB interrupt), the old collection is appended to the new one. Upon loading the returned string is split to enable removing of the old items. |
||
|---|---|---|
| modules | ||
| .gitignore | ||
| 4grab.py | ||
| backend.py | ||
| config.py | ||
| COPYING | ||
| download.py | ||
| htmlparser.py | ||
| progressbar.py | ||
| README | ||
| sorter.py | ||
| util.py | ||
4grab - a utility that download pictures from a certain website. 4grab has been written to help me download wallpapers from a certain website, though it should easily be possible to use it for a general purpose image-downloader for that website. 4grab downloads pages 0-10 from the given category and parses these pages looking for links to threads. Afterwards it downloads these thread pages and starts looking in those for image links, skipping one each time because images there are linked to twice. Finally it goes through all the collected image links and checks to see whether it already exists on the disk and if not, downloads it. 4grab is written in Python and therefore needs the python interpreter (http://www.python.org) to be installed on your system. It is being tested on a Fedora 12 machine with Python 2.6.2 installed, and a Windows XP machine with Python 2.6.4 installed. v0.2.1 has been reported to work under Windows 7 as well.