Simple "breaking news" service with the help of Superfeeder.com

August 28 - 2009

I have made a simple Breaking news web page with the help of Superfeedr.com and XMPP. I have made this for my personal use and as a test, but maybe someone else finds it interesting too.

The system is working now the following way:

   +------------------------+
   |    Superfeeder.com     |
   |         PubSub         |
   +------------------------+
               |
   +-----------v------------+
   |   Lobstermonster.org   |
   |                        |
   | Memcache        PubSub |
   +-------------------^----+   
        |              |
   -----v--------------v-----
           WebClients
	

Superfeeder.com is publishing items of BBC News' Latest Published Stories and Yahoo! News: Technology News. Lobstermonster.org is receiving those feeds and when it does, it stores the feeds to memcached and publishes them to every webclient online.

When a client opens the web page, the content on the page is first displayed from memcache. The user subscribes to Lobstermonster's pubsub service as anonymous and does a session based subscription to the Lobstermonster's SuperFeedr pubsub node. After succesfull subscription the client is starting to receive the Breaking News as "real time".

With this kind of basic system anything could be displayed on web realtime with very minimum hardware.

As always I'm using Amazing Strophe at the "webside" to handle the connection to my XMPP system.

List of all post on LobsterMonster.org