Writing my S3 command line toolset
Aug. 22nd, 2007 08:24 pm![[personal profile]](http://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
fallenpegasusSo, there was a command line toolset for manipulating S3, called the Hanzoarchives hanzo-s3-tools. They were kind of iffy in the installation and documentation, but they worked, more or less. However, their handling of S3 ACLs was pretty poor, very not useful. And as the last straw, it seems to have gone offline and vanished.
On the other hand, there is a really good Perl library, Net::Amazon::S3. Many of my clients are more or less Perl shops, so I have been recommending that they install it. But that module lacks the scripts that bring functionality out to the command line.
So I'm writing them. Today, I've got s3mkbucket and s3rmbucket working, complete with handling of ACLs and TLS. Tomorrow will be s3putacl and s3getacl, and quickly following will be s3put, s3get, s3head, s3rm and s3ls.
All open source, of course. It will be available in my public repository, and I'll see if I can get the Net::Amazon::S3 to accept it as a patch. If he doesn't, I'll just make a Freshmeat project, and advertise it that way.
On the other hand, there is a really good Perl library, Net::Amazon::S3. Many of my clients are more or less Perl shops, so I have been recommending that they install it. But that module lacks the scripts that bring functionality out to the command line.
So I'm writing them. Today, I've got s3mkbucket and s3rmbucket working, complete with handling of ACLs and TLS. Tomorrow will be s3putacl and s3getacl, and quickly following will be s3put, s3get, s3head, s3rm and s3ls.
All open source, of course. It will be available in my public repository, and I'll see if I can get the Net::Amazon::S3 to accept it as a patch. If he doesn't, I'll just make a Freshmeat project, and advertise it that way.
![[identity profile]](http://www.dreamwidth.org/img/silk/identity/openid.png){kind=small}
no subject
Date: 2007-08-23 03:30 am (UTC)no subject
Date: 2007-08-23 03:36 am (UTC)Your shop is using S3? What for? Need any help with it?
no subject
Date: 2007-08-23 03:52 am (UTC)My shop doesn't use it but I wanted to learn more about it for my own projects. There had been some rumblings of moving our kiosk to Linux but I really doubt that's going to happen so we're in the Windows world for a while. Which reminds me I want to dig more into Net::Amazon::S3 because I like it more than SOAP::Amazon::S3 but it doesn't install on Win32 with Strawberry Perl yet.
I was planning on using S3 for an offsite backup site and hosting a few files to share. My future plans are start learning about S3 then moving on to EC2. I'm still thinking about that public printing project you suggested a while ago and those two services with SQS might be just the thing to get a lot of capacity without a large investment in hardware.
So far I think it's clear in my head but I'll keep you in mind if I have any questions.