Matt Coneybeare


Public Domain Fail - Is Blocking Access to Public RSS Feeds and Content.

| Comments

UPDATE: 7/12/10 10:16PM

All functionality seems to have been restored. Whether this was a hiccup in the system (probable) or a reversal of the blocking we will never know.  I am just glad that it has been resolved with minimal emails/posts on my part.



I have an iPhone app called Obama Speeches. It is an app that publishes the weekly addresses of the President, along with other important speeches made by him. All content is in the public domain, and the content is retrieved from public URL’s. I have been using the same script for over a year to automatically pull down the content, until today. I started getting 404’s.

A quick wget of the feed URL confirmed this to be true:

[ps6736]$ wget
           => `rss.xml'
Connecting to||:80... connected.
HTTP request sent, awaiting response... 404 Not Found
07:03:10 ERROR 404: Not Found.

Hmmm. I checked on a few other machines and found that it was going through fine. WTF? I tried using CURL, open-uri and other forms of fetching the RSS feed from but they still blocked me or redirected my requests from this machine. Every attempt to connect from other machines worked fine.

coneybeare $ wget
--2010-07-12 10:03:45--
Connecting to||:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 97387 (95K) [application/rss+xml]
Saving to: `rss.xml'

100%[=====================================>] 97,387       239K/s   in 0.4s

2010-07-12 10:03:46 (239 KB/s) - `rss.xml' saved [97387/97387]

I also checked other URL’s to make sure this machine actually was connected an lo and behold, I could get a connection. Don’t worry, I have it working again through tunneling into other machines to fetch the feed but I shouldn’t have to — Public domain is public domain.

I think that is unhappy with my app (and it’s success) competing with theirs and tried to take me down. The problem is that I am doing nothing illegal here and they have no right to block access to the public feeds and content. Of course, saying this makes me a conspiracy theorist but what else can I deduce from the situation?

Hey US Gov: If you have a problem with my frequency or method of fetching the public data, please try to contact me instead of shutting me off completely.


My name is Matt Coneybeare, I design and develop for the web, iOS (iPhone, iPad and iPod Touch), and MacOS out of New York City. In 2008 I started a software company called Urban Apps that has made some pretty popular apps such as Ambiance and Hourly News. In 2019, I joined the team at Ticket Evolution as a Senior Software Engineer. My current Stack Overflow reputation is about 27k.

I was a Rockstar a decade ago, but then went back to school and collected a Bachelor's Degree in Computer Science from U.C. Berkeley and a MBA from Quantic. Now I am settled down with my beautiful wife Di and our dog Hamachi. When not at my desk, I love exploring New York City as a Yelp Elite, or training for marathons.

Contact information

Matt Coneybeare