Reply to topic  [ 12 posts ] 
Download script 
Author Message
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 7:35 pm
Posts: 6580
Location: Getting there
Reply with quote
Hi,

Does anyone know of a way to download lots of files if I know the urls (or url pattern for them).

The files are all jpgs and the pattern will be something like...

http://www.website.com/camera1/image000001.jpg
http://www.website.com/camera1/image000002.jpg
http://www.website.com/camera1/image000003.jpg
http://www.website.com/camera1/image000004.jpg
http://www.website.com/camera1/image000005.jpg
http://www.website.com/camera1/image000006.jpg
...

I'm not too fussed about how long it takes or how fast/slow it goes I just don't want to have to download thousands of images manually.

Thanks

_________________
Oliver Foggin - iPhone Dev

JJW009 wrote:
The count will go up until they stop counting. That's the way counting works.


Doodle Sub!
Game Of Life

Image Image


Wed Nov 10, 2010 9:16 am
Profile WWW
Moderator

Joined: Thu Apr 23, 2009 6:13 pm
Posts: 7262
Location: Here, but not all there.
Reply with quote
Would you be able to do this with an FTP app? Do you have access to the server where the photos are?

_________________
My Flickr | Snaptophobic Bloggage
Heather Kay: modelling details that matter.
"Let my windows be open to receive new ideas but let me also be strong enough not to be blown away by them." - Mahatma Gandhi.


Wed Nov 10, 2010 9:20 am
Profile
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 7:35 pm
Posts: 6580
Location: Getting there
Reply with quote
I don't think I can access it that way.

I'll have a try at home when I'm not locked down by proxy servers.

_________________
Oliver Foggin - iPhone Dev

JJW009 wrote:
The count will go up until they stop counting. That's the way counting works.


Doodle Sub!
Game Of Life

Image Image


Wed Nov 10, 2010 9:30 am
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 6:36 pm
Posts: 5159
Location: /dev/tty0
Reply with quote
In terminal:
Code:
cd ~/Desktop
curl -O "http://www.website.com/camera1/image00000[1-6].jpg";


That should do the trick...It'll dump them on your Desktop


Wed Nov 10, 2010 9:35 am
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 7:35 pm
Posts: 6580
Location: Getting there
Reply with quote
forquare1 wrote:
In terminal:
Code:
cd ~/Desktop
curl -O "http://www.website.com/camera1/image00000[1-6].jpg";


That should do the trick...It'll dump them on your Desktop

I'll try that when I get home.

Again, stupid proxy at work blocking everything.

_________________
Oliver Foggin - iPhone Dev

JJW009 wrote:
The count will go up until they stop counting. That's the way counting works.


Doodle Sub!
Game Of Life

Image Image


Wed Nov 10, 2010 9:49 am
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 6:36 pm
Posts: 5159
Location: /dev/tty0
Reply with quote
For completeness, if you are on something and curl isn't available, then this should work equally as well:
Code:
wget -c "http://www.website.com/camera1/image00000[1-6].jpg


Wed Nov 10, 2010 9:51 am
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 9:40 pm
Posts: 5288
Location: ln -s /London ~
Reply with quote
I think in the past I've used a plugin (iThink to Firefox) that grabbed stuff. It may even have been this one.

_________________
timark_uk wrote:
Gay sex is better than no sex

timark_uk wrote:
Edward Armitage is Awesome. Yes, that's right. Awesome with a A.


Wed Nov 10, 2010 10:03 am
Profile
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 6:36 pm
Posts: 5159
Location: /dev/tty0
Reply with quote
EddArmitage wrote:
I think Ben's idea was best, use his. Command Line FTW!


:wink:


Wed Nov 10, 2010 10:05 am
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 7:35 pm
Posts: 6580
Location: Getting there
Reply with quote
EddArmitage wrote:
I think in the past I've used a plugin (iThink to Firefox) that grabbed stuff. It may even have been this one.

Frickin' awesome man!

They are downloading as we speak.

The only way I could access them was by typing the URL as the links were all dynamic.

But with DownThemAll I can add a url pattern batch and it goes :D

_________________
Oliver Foggin - iPhone Dev

JJW009 wrote:
The count will go up until they stop counting. That's the way counting works.


Doodle Sub!
Game Of Life

Image Image


Wed Nov 10, 2010 10:22 am
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 9:40 pm
Posts: 5288
Location: ln -s /London ~
Reply with quote
forquare1 wrote:
EddArmitage wrote:
I think Ben's idea was best, use his. Command Line FTW!
:wink:

Fogmeister wrote:
EddArmitage wrote:
I think in the past I've used a plugin (iThink to Firefox) that grabbed stuff. It may even have been this one.

Frickin' awesome man!

Pwned! (8-p)

_________________
timark_uk wrote:
Gay sex is better than no sex

timark_uk wrote:
Edward Armitage is Awesome. Yes, that's right. Awesome with a A.


Wed Nov 10, 2010 10:35 am
Profile
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 7:35 pm
Posts: 6580
Location: Getting there
Reply with quote
LOL, this is taking longer than I expected :D

_________________
Oliver Foggin - iPhone Dev

JJW009 wrote:
The count will go up until they stop counting. That's the way counting works.


Doodle Sub!
Game Of Life

Image Image


Wed Nov 10, 2010 4:26 pm
Profile WWW
I haven't seen my friends in so long
User avatar

Joined: Thu Apr 23, 2009 9:40 pm
Posts: 5288
Location: ln -s /London ~
Reply with quote
Fogmeister wrote:
LOL, this is taking longer than I expected :D

How many and what are they??? (8-p)

_________________
timark_uk wrote:
Gay sex is better than no sex

timark_uk wrote:
Edward Armitage is Awesome. Yes, that's right. Awesome with a A.


Wed Nov 10, 2010 4:31 pm
Profile
Display posts from previous:  Sort by  
Reply to topic   [ 12 posts ] 

Who is online

Users browsing this forum: No registered users and 4 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group
Designed by ST Software.