UPDATE: 7/12/10 10:16PM
All functionality seems to have been restored. Whether this was a hiccup in the system (probable) or a reversal of the blocking we will never know. I am just glad that it has been resolved with minimal emails/posts on my part.
I have an iPhone app called Obama Speeches. It is an app that publishes the weekly addresses of the President, along with other important speeches made by him. All content is in the public domain, and the content is retrieved from public URL’s. I have been using the same script for over a year to automatically pull down the content, until today. I started getting
wget of the feed URL confirmed this to be true:
[ps6736]$ wget http://www.whitehouse.gov/podcast/video/weekly-addresses/rss.xml --07:03:09-- http://www.whitehouse.gov/podcast/video/weekly-addresses/rss.xml => `rss.xml' Resolving www.whitehouse.gov... 188.8.131.52, 184.108.40.206 Connecting to www.whitehouse.gov|220.127.116.11|:80... connected. HTTP request sent, awaiting response... 404 Not Found 07:03:10 ERROR 404: Not Found.
Hmmm. I checked on a few other machines and found that it was going through fine. WTF? I tried using CURL, open-uri and other forms of fetching the RSS feed from whitehouse.gov but they still blocked me or redirected my requests from this machine. Every attempt to connect from other machines worked fine.
coneybeare $ wget http://www.whitehouse.gov/podcast/video/weekly-addresses/rss.xml --2010-07-12 10:03:45-- http://www.whitehouse.gov/podcast/video/weekly-addresses/rss.xml Resolving www.whitehouse.gov... 18.104.22.168, 22.214.171.124 Connecting to www.whitehouse.gov|126.96.36.199|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 97387 (95K) [application/rss+xml] Saving to: `rss.xml' 100%[=====================================>] 97,387 239K/s in 0.4s 2010-07-12 10:03:46 (239 KB/s) - `rss.xml' saved [97387/97387]
I also checked other URL’s to make sure this machine actually was connected an lo and behold, I could get a connection. Don’t worry, I have it working again through tunneling into other machines to fetch the feed but I shouldn’t have to — Public domain is public domain.
I think that whitehouse.gov is unhappy with my app (and it’s success) competing with theirs and tried to take me down. The problem is that I am doing nothing illegal here and they have no right to block access to the public feeds and content. Of course, saying this makes me a conspiracy theorist but what else can I deduce from the situation?
Hey US Gov: If you have a problem with my frequency or method of fetching the public data, please try to contact me instead of shutting me off completely.