smdown.pl - Unix command-line album downloader

darryl · October 30, 2006

Hi -- a while back I wrote a quick and dirty album downloader in Perl that scraped the HTML from your albums, grabbed links to the originals, and used curl to download the images.

One drawback to the hack was that it didn't get your files back to their original filename.

Well, I finally sat down, figured out this Smugmug API thing, and wrote myself a new version.

Basically it works like this:

smdown.pl --login login --password password http://your.smugmug.com/album

If you use John Ruttenberg's great sm_tool.py for uploading, your .smugmugrc file with login: and password: should work for smdown.pl as well, meaning you won't have to use --login and --password every time you call this script.

It requires a few fairly standard Perl modules (XML::Simple, Getopt::Long and File::Spec) and it makes calls to curl to actually talk to the Smugmug website. These come standard on most Linux/FreeBSD boxes, as well as OS X. You might be able to get this script to work in Windows as well, but I don't have the time nor inclination to test this.

Here's the link: http://www.darryl.com/smdown/

Feedback welcome. Enjoy!

devbobo · October 30, 2006

Hey Darryl,

I have written a fair bit of scraping stuff in perl but not for smugmug, I am interested to know why did decided to use curl in of something like LWP, which is part of the perl distribution ?

Cheers,

David

devbobo · October 30, 2006

darryl · October 31, 2006

devbobo wrote:

Also, you are using the old api endpoints...

[snip]

note, you can drop the Version parameter from the login method.

Cheers,

David

Ah, thanks David. Fixed. I didn't realize that 1.1.1 was out of beta. When I was testing w/o beta.mg or a version number in the URL, the Heavy bit didn't work for images.

darryl · October 31, 2006

devbobo wrote:

Hey Darryl,

I have written a fair bit of scraping stuff in perl but not for smugmug, I am interested to know why did decided to use curl in of something like LWP, which is part of the perl distribution ?

Cheers,

David

Laziness. I did all my testing on the command-line w/ curl, so it was easier for me to cut and paste those lines into a Perl script that handles all of the logic. I come from a lazy sysadmin bastard background, so that's how I work, using Perl to glue together system tools.

Also, I think like how curl displays stats about download speed and status. Saves me from having to write progress bars, etc.

:-}

--Darryl

devbobo · October 31, 2006

darryl wrote:

Ah, thanks David. Fixed. I didn't realize that 1.1.1 was out of beta. When I was testing w/o beta.mg or a version number in the URL, the Heavy bit didn't work for images.

Version 1.1.1 isn't out of beta yet, Don's has just changed the api endpoints to make things easier for future development.

darryl · October 31, 2006

devbobo wrote:

Version 1.1.1 isn't out of beta yet, Don's has just changed the api endpoints to make things easier for future development.

Ah, and it clearly *is* still in Beta. In smugmug.albums.getInfo, <info> changed to <Albums>. Or maybe that's because I was using the old endpoints.

Anyways, lost my Album titles for a little bit back there. I probably should do a bit more error checking. :-}

--Darryl

darryl · November 16, 2006

Hi all...

Well, I finally got around to trying my script on my OS X box, and lo and behold, XML::Simple isn't installed by default. Well, phooey.

So I hacked it to work without a real XML parser. Suuuuper-hackish, but hey, it works for me. :-}

http://www.darryl.com/smdown/

Grab the one named, smdown-noxml.txt and save it as smdown.pl

--Darryl

smdown.pl - Unix command-line album downloader

Comments