[jdev] PubSub & News Feeds

[JabberForum]

Kelly S;548 Wrote: 
> Hiya.
> From what I can read on PubSub its clear how users subscribe to feeds
> and receive events but how can I handle a user requesting a feed that is
> not indexed on the server yet? So that the server can now start indexing
> that feed and begin Publishing new entries it pulls (I will be writting
> the service which starts pulling feeds off the web).
> 

Here as far as I understand, and remembering your previous post, you
want to be able to transform any RSS publication into a xmpp node
publication. So the point here is that your pubsub tree is "dynamic".
>From what I know, this is not in the basic XEP, because it implies a
relation between the web and xmpp, which has not been planned (you
wanted to tie the http url and the pubsub node, for instance a rss in
http://subdomain.domain/some/path/feed/ would be in the node
/subdomain.domain/some/path/feed/, didn't you?).
Yet this is probably very easy to implement such service on a server:
when querying a subscription, it would check whether the address you
entered is indeed linking to a rss feed, then creating the associated
node for beginning to pull.

> Also a bunch of concerns pop into my head that I'm still unclear about
> when maintaining all this "feed" data. 1. Is there any way I can just
> publish the latest feeds I pulled down and pubsub discard any duplicates
> that may already exist? Or is the right way to handle this is to query
> every single entry individually to check if they exist before publishing
> them? 
> 

Here you would do simply like any normal agregator already does: you
check the time. You know the last time you got any news on a RSS, hence
you stop reading the feed to this date.

> 
> Thanks so much for your time 
> 

You're welcome. ;-)


-- 
Jehan
------------------------------------------------------------------------
Jehan's Profile: http://www.jabberforum.org/member.php?userid=16911
View this thread: http://www.jabberforum.org/showthread.php?t=149