A planet app for your Django project. It crawls a set of feeds, aggregates them on a single page and re-publishes the entries with RSS and Atom feeds.
This app is based on Django's community aggregator, updated to Django 1.2 and slightly improved.
Installation
pip install -e git+git://github.com/brutasse/django-aggregator#egg=aggregatorRequirements:
- Django >= 1.2
- The universal feedparser
Configuration
Add aggregator to your INSTALLED_APPS & run syncdb.Templates
Create a simple view that renders a template. Use the following template tags to fetch & render the data:- {% load aggregator_tags %} to load the template library
- {% get_feed_list as feed_list %} to fetch the feeds
- {% get_entries <num_latest> as entries_list %} to fetch the latest entries
<h2>Indexed feeds</h2> <ul> {% for feed in feed_list %} <li>{{ feed.title }} (<a href="{{ feed.public_url }}">site</a>)</li> {% endfor %} </ul>To render the latest entries:
<h2>Latest entries</h2> {% for entry in entries_list %} <div class="entry"> <h2>{{ entry.feed.title }}: {{ entry.title|safe }}</h2> <p>{{ entry.summary|safe }}</p> <p> Published: {{ entry.date|date }}. <a href="{{ entry.link }}">Read more</a> </p> </div> {% endfor %}If you want to render only a preview of the entries, you can do:
{{ entry.summary|safe|truncatewords_html:30 }}
Feeds
To publish some feeds of the aggregated content, subclass the base Feed class:from aggregator.feeds import Feed class MyAwesomeFeed(Feed): title = 'Aggregated content on <topic>' link = 'http://example.com' description = 'A more detailed description'You can have Atom feeds:
from django.utils.feedgenerator import Atom1Feed class MyAwesomeAtomFeed(MyAwesomeFeed): feed_type = Atom1Feed subtitle = MyAwesomeFeed.descriptionAnd add them to your URLs:
from myproject.feeds import MyAwesomeFeed, MyAwesomeAtomFeed urlpatterns = patterns('', # ... url(r'^path/to/feeds/rss/$', MyAwesomeFeed(), name='aggregator_rss'), url(r'^path/to/feeds/atom/$', MyAwesomeAtomFeed(), name='aggregator_atom'), # ... )When you're done you can add your feeds' URLs in the <head> section of your website.
Usage
Adding some feeds
Go to the admin and add the different feeds' name, title & URLs.Updating the feeds
There are two management commands:- mark_defunct_feeds will fetch all the registered feeds and check if they return a 404 or 500 response. If so, they are marked as "defunct" and will be skipped at each update.
- update_feeds fetches all the non-defunct feeds and checks for new content.
PYTHONPATH=/path/to/project DJANGO_SETTINGS_MODULE=settings_module 15,45 * * * * python /path/to/manage.py update_feeds 0 */6 * * * python /path/to/manage.py mark_defunct_feeds
from https://github.com/brutasse/django-aggregator