x404.co.uk
http://www.x404.co.uk/forum/

Download script
http://www.x404.co.uk/forum/viewtopic.php?f=4&t=11418		 Page 1 of 1
Author:  Fogmeister [ Wed Nov 10, 2010 9:16 am ]
Post subject:  Download script
Hi,

Does anyone know of a way to download lots of files if I know the urls (or url pattern for them).

The files are all jpgs and the pattern will be something like...

http://www.website.com/camera1/image000001.jpg
http://www.website.com/camera1/image000002.jpg
http://www.website.com/camera1/image000003.jpg
http://www.website.com/camera1/image000004.jpg
http://www.website.com/camera1/image000005.jpg
http://www.website.com/camera1/image000006.jpg
...

I'm not too fussed about how long it takes or how fast/slow it goes I just don't want to have to download thousands of images manually.

Thanks
Author:  HeatherKay [ Wed Nov 10, 2010 9:20 am ]
Post subject:  Re: Download script
Would you be able to do this with an FTP app? Do you have access to the server where the photos are?
Author:  Fogmeister [ Wed Nov 10, 2010 9:30 am ]
Post subject:  Re: Download script
I don't think I can access it that way.

I'll have a try at home when I'm not locked down by proxy servers.
Author:  forquare1 [ Wed Nov 10, 2010 9:35 am ]
Post subject:  Re: Download script
In terminal:
Code:
cd ~/Desktop
curl -O "http://www.website.com/camera1/image00000[1-6].jpg";


That should do the trick...It'll dump them on your Desktop
Author:  Fogmeister [ Wed Nov 10, 2010 9:49 am ]
Post subject:  Re: Download script
forquare1 wrote:
In terminal:
Code:
cd ~/Desktop
curl -O "http://www.website.com/camera1/image00000[1-6].jpg";


That should do the trick...It'll dump them on your Desktop

I'll try that when I get home.

Again, stupid proxy at work blocking everything.
Author:  forquare1 [ Wed Nov 10, 2010 9:51 am ]
Post subject:  Re: Download script
For completeness, if you are on something and curl isn't available, then this should work equally as well:
Code:
wget -c "http://www.website.com/camera1/image00000[1-6].jpg
Author:  EddArmitage [ Wed Nov 10, 2010 10:03 am ]
Post subject:  Re: Download script
I think in the past I've used a plugin (iThink to Firefox) that grabbed stuff. It may even have been this one.
Author:  forquare1 [ Wed Nov 10, 2010 10:05 am ]
Post subject:  Re: Download script
EddArmitage wrote:
I think Ben's idea was best, use his. Command Line FTW!


:wink:
Author:  Fogmeister [ Wed Nov 10, 2010 10:22 am ]
Post subject:  Re: Download script
EddArmitage wrote:
I think in the past I've used a plugin (iThink to Firefox) that grabbed stuff. It may even have been this one.

Frickin' awesome man!

They are downloading as we speak.

The only way I could access them was by typing the URL as the links were all dynamic.

But with DownThemAll I can add a url pattern batch and it goes :D
Author:  EddArmitage [ Wed Nov 10, 2010 10:35 am ]
Post subject:  Re: Download script
forquare1 wrote:
EddArmitage wrote:
I think Ben's idea was best, use his. Command Line FTW!
:wink:

Fogmeister wrote:
EddArmitage wrote:
I think in the past I've used a plugin (iThink to Firefox) that grabbed stuff. It may even have been this one.

Frickin' awesome man!

Pwned! (8-p)
Author:  Fogmeister [ Wed Nov 10, 2010 4:26 pm ]
Post subject:  Re: Download script
LOL, this is taking longer than I expected :D
Author:  EddArmitage [ Wed Nov 10, 2010 4:31 pm ]
Post subject:  Re: Download script
Fogmeister wrote:
LOL, this is taking longer than I expected :D

How many and what are they??? (8-p)
Page 1 of 1 All times are UTC
Powered by phpBB® Forum Software © phpBB Group
https://www.phpbb.com/