Sunday, March 15, 2009

iTunes Connect Scraper

Just a quick note about a, well, smaller release than most of the others. As have many other iPhone developers, we've been pretty frustrated that we're not able to automate the process of getting sales reports from the iTunes Connect portal. It's frustrating because it means someone has to have the responsibility of logging in and downloading them every day, and we've just got better things to be doing (like making great software!).

So we're trying to be part of the solution. Last night, I put together a simple script using the fabulous Beautiful Soup framework to automatically log in and download the latest daily report for you. Paragon of software engineering excellence it is not, but it does rather neatly solve this problem for us. So if you're an iPhone developer, check it out here. It's BSD licensed, meaning you can do pretty much whatever you want with it, but we'd love to hear about any novel uses you find for it, and we'll gladly accept patches for bugfixes or new features or what have you.

I hope you find it useful!

James -- Co-founder and CTO.


Taylor Steil said...

Thanks for making this! I am attempting to use it but I'm getting an error when I run it.

The error is here:

It looks like cannot parse the HTML. I printed out what it is trying to parse and it looks like it is a smaller version of the normal itunes connect login form, repeated about 20 times. It's very weird that it is repeated.

Have you guys ever seen anything like this? I'm 100% sure my login & password are correct.

I've tried with python 2.5 and 2.6, on Windows and Cygwin. I haven't tried on OSX or Linux.

If I can get it working, I'm going to try and adept it to run on Google App Engine.

Taylor Steil said...

Hey James, I figured out my problem. BeautifulSoup wasn't setup or configured properly.

Builder said...

Hey, I wrote an iPhone app that did this. It automated the log into itunes connect and displayed the top 50 downloads for the previous day. I submitted it but it got rejected by Apple. Apparently your not allowed to scrape apple sites in an app. Too bad because I use it every day I willing to post it to your google code project if your interested. It was simple code but I am glad I didn't spend more time graphing the sale reports. contact me @ info at scoutic dot com