Category Archives: Web sites

RSS Aggregation Server Side

This topic will be a work in progress.

I am researching RSS feed tools with the specific purpose of reducing the traffic and hits on external RSS feeders by staff within an office.

So far my reading has included:

So what’s the point, other than I have a limited understanding of RSS?

The point is that on intranet sites the staff are consumers of RSS feeds from external sites. The ability for staff to add their own selection of feeds to their section of the intranet is at the root of this topic while the actual issues are perhaps less obvious.

The first issue is what happens to the external traffic load when multiple users select the same feed as a source for their intranet page. When it’s one or two users, it’s like ‘so what?’ but if 300 staff decide to add http://www.abc.net.au/news/syndicate/topstoriesrss.xml as a direct feed then several things happen.

  • Cost to ABC News for supplying the same data 300 times
  • Cost to the business in downloading (proxy servers, etc, as a peripheral issue)
  • Risk that ABC News see only the business external IP address hitting them 300 x Page Views per day and potentially bans the external IP address from updates.
  • If ABC News is not accessible, then every page with that link will take some time to download while it times out on the RSS feed. (A performance issue that the end user blames on the internal IT department…..)

The second issue is that by allowing open access to RSS feeds there is the risk of editorial control for the business being bypassed and opening up issues of racism, pornography, and the gamut of work-place relation issues that we have to deal with today.

So my goal is to identify a process that provides:

  • RSS Feed Aggregation
  • Internal caching and refresh of content (handling any broken feeds)
  • Provides a controlled output of feeds to the internal masses
  • Assists with managing the feeds from a user request perspective
  • Minimises the traffic to and from the outside world.

I have more reading to do!

What sites?

So what web sites do I work with?

Most of the websites I work with are hosted with WrenMaxwell and consist of ecommerce stores based in osCommerce (or CRELoaded).

I also have my hobby of toy cars – old ones from pre-1980 – which is found at RecoverToy. I am currently taking a break from that while I sort out some other things, like my server and site hosting, and getting a kitchen fitted (finally) to our house.

My business interests include Marble Bay (25 years of IT) which keeps me fully occupied.

This blog and a domain I set up for the Howden family to use at Howden.net.au round out the list of sites.

Hello world!

A first post just to kick things off.

I’ve been blogging in one form or another for a decade. It just was not called blogging when I started off with Bigpond’s free webspace (now defunct).

This blog is being written at the Australian TechEd at the Gold Coast Convention Centre on my new HP Mini.

The new thowden.com.au and thowden.com domains are hosted away from my home as my home server (I’ve had one or more servers on my Bigpond cable modem setup since – well, forever – and about a month ago I had two drives collapse rendering the server useless. Time to re-assess and from a green, environmental perspective it seemed high-time to host my various sites on a central server.

So here I am with a new WordPress site and the task of deploying another 3 or 4 sites from my backups out to the big world outside my shed.