Commit graph

43 commits

Author SHA1 Message Date
Tom Willemsen
05724b37b3 Archlinux uses python2 2011-05-27 11:36:28 +02:00
ryuslash
0323ddbed8 interrupt, save
On keyboard interrupt in the regular flow of downloading the collected images of this session and of last session are saved so as not to destroy the archive accidentally this way.
If an item is added to the new collection, it is removed from the old one.
If a save is being dumped (uncleanly saved because of KB interrupt), the old collection is appended to the new one.
Upon loading the returned string is split to enable removing of the old items.
2010-04-27 21:06:41 +02:00
ryuslash
ef79c9991b Nasty bug where it didn't actually save anything 2010-04-22 22:24:38 +02:00
ryuslash
99b87aeffb Log function works, need to start using it now 2010-04-21 15:40:20 +02:00
ryuslash
b5aac62357 Merge branch 'kirbybase' into develop 2010-04-19 09:16:59 +02:00
ryuslash
af529bcd4e Not checking and kirbybase
Using kirbybase to store downloaded images
A nasty bug that always returned the wrong result when checking whether an image had already been downloaded has been fixed
2010-04-19 09:16:04 +02:00
ryuslash
2db5555609 Archive lookup
4grab was saving the archived images to the wrong place, which is now fixed
2010-04-08 15:14:12 +02:00
ryuslash
9fb2b4ff58 Fixed Python 2.6 compatibility issue
Select was using "raise 'No Match'" to break from non-matches, this is
deprecated
2010-04-08 15:12:26 +02:00
ryuslash
a567e8630f Added kirbybase module 2010-04-08 15:10:48 +02:00
ryuslash
dfaa24b1b6 Error with archive
The archive function in sorter.py didn't archive to .arch, now it does
2010-04-07 23:30:59 +02:00
ryuslash
d58d029202 Seperate download function
download function has been seperated from get_thread_links and get_image_links
2010-03-30 15:59:15 +02:00
ryuslash
7ab6d2911f Merge branch 'non-fixed-pages' into develop 2010-03-25 22:28:32 +01:00
ryuslash
14e2b0cc54 non-fixed page count
4grab no longer assumes either 11 or 16 pages, it will keep trying to collect new pages up to the moment it receives a 404 error
2010-03-25 22:28:08 +01:00
ryuslash
018abb7da1 Merge branch 'by-date' into develop 2010-03-22 15:18:15 +01:00
ryuslash
3980ccf38e Sorter also sorts by date now 2010-03-22 15:17:55 +01:00
ryuslash
4b70374e9d FAIL and print
If source and dest in copy are the same, it is no longer reported
If an image can't be read, it is counted as failed
2010-03-19 16:08:39 +01:00
ryuslash
96247d41d5 Merge branch 'sorting' into develop 2010-03-19 08:26:26 +01:00
ryuslash
7f8dfa1d30 Sorting, multi category, multi resolution
After a file has been downloaded a callback function can now be called.
The callback function I call checks to see if the resolution of the image appears in the collection of resolutions that has been entered in the configuration file and deletes/moves accordingly.
If a file can not be read (which I have noticed happens sometimes), it is removed, not copied and not archived so that it can be retried later.
4grab got a new command-line option, -s --sorter, to sort out old images, running python sorter.py has the same effect, but this seemed pretties.
theoretically multiple categories could now be entered into the configuration file seperated by ',', but this hasn't been tested yet.
mutliple resolutions could be entered into the configuration file, seperated by ',' like so: 1680x1050,1920x1200.
Configuration now checks to see if all the necessary properties are available in the configuration file, if one is missing, it tries to create it.
2010-03-19 00:18:04 +01:00
ryuslash
4a9cc7e2b6 optioncreator, extra options
config now has an optioncreator property that will allow another module to select how to prompt for a property
resolutions and archive options have been added to config file for sorting functionality
2010-03-17 23:11:18 +01:00
ryuslash
8e101c92f9 Disconnected the property creation function
The function used to create a new property has been changed to be a callback function, so that later on a UI might use a dialog.
2010-03-16 23:17:46 +01:00
ryuslash
caba2811b9 KeyboardInterrupt, 80 columns
Keyboard Interruption (CTRL+C) should now be handled gracefully
Tried making the 4grab.py file no more than 80 columns wide
2010-03-12 21:50:10 +01:00
ryuslash
b546de2645 /bin/env seems less reliable than /usr/bin/python 2010-03-10 12:13:27 +01:00
ryuslash
a77b9c9d09 Merged 2010-03-07 00:31:40 +01:00
ryuslash
ba6b659fb8 Removed download.py dependency
download.py no longer requires progressbar.py, it now contains a class that accepts another class as a parameter, this may be useful later when adding different ways of interaction
2010-03-07 00:20:37 +01:00
ryuslash
9ed19eae00 Who knows what the hell I did this time 2010-02-12 00:34:36 +01:00
ryuslash
d41ab5335e Removed some comments 2010-02-12 00:18:34 +01:00
ryuslash
5516dbbcae Stopped saying Failed and Skipped things
Now it summarizes at the end
2010-02-12 00:04:34 +01:00
ryuslash
c85a69a893 Added a wizard
The wizard uses his robe and wizard hat to help you download images
2010-02-11 23:46:23 +01:00
ryuslash
f09ea95c84 Added --thread
With --thread a signle thread ID or thread URL can be entered.
If thread is a URL, it will download it.
If thread is an ID, a category must also be set.
2010-02-11 22:05:37 +01:00
ryuslash
420bc469a4 Added --category
With --category, a category can be specified which will be downloaded, but only that run, next time the configured category will take over again
2010-02-11 21:20:16 +01:00
ryuslash
68be1fe204 Added license info and README 2010-02-09 02:45:56 +01:00
ryuslash
1b09267876 configuration settings and startfile
Configuration Settings can now be changed with the -e command line argument
execution of 4grab has been moved to 4grab.py, but should also still work with download.py
2010-02-09 02:10:17 +01:00
ryuslash
91e0b5dc66 merged with commit from RAAM 2010-02-09 01:35:17 +01:00
ryuslash
32c4471273 working on the command-line arguments here 2010-02-09 01:32:42 +01:00
ryuslash
cc571e6d80 Still wasn't working on windows
if savedir did not exists, then downloading would never work. Now if it does not exist, it is created, or it crashes and burns if it isn't allowed.
2010-02-08 01:48:12 +01:00
unknown
7707d5d3c6 Fixed in windows
Windows was giving trouble with the os.getenv(HOME) which can be executed in the python shell and IDLE and will return C:\Documents and Settings\username\, but when running a script it will return None.
If os.getenv(HOME) is None, then now the exec dir will be used instead
2010-02-08 01:24:18 +01:00
ryuslash
53c7802ae2 Configuration
* A configuration file is made if one hasn't been found
* Certain values (currently download category and location) are stored in config file.
2010-01-26 20:20:39 +01:00
ryuslash
c737789105 Started working on configuration file 2010-01-18 20:08:38 +01:00
ryuslash
4a10e87d3d self.fill_char was named self.fill_cahr 2010-01-17 16:55:11 +01:00
ryuslash
e750aada18 progress bar windows
* Made the progress bar 1 character smaller by default, good for windows CMD
2010-01-17 16:43:42 +01:00
ryuslash
10f2f918a1 added crunchbang 2010-01-17 03:56:00 +01:00
ryuslash
025a723a5a Parser seperation, progress bar
* Seperated the parser from the downloader code.
* Added a progressbar class, to make it look fancier
* Created some functions to do all the work in downloader.py, cleaner now
* Changed parser.py to htmlparser.py, since it was conflicting with a built-in module
2010-01-17 03:48:23 +01:00
ryuslash
fb65246575 Initial commit
Can download images from /w/
2010-01-15 08:22:17 +01:00