[ANN] RSS River Plugin

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[ANN] RSS River Plugin

dadoonet

Hi all,

 

 

I’m happy to share with the ES community my first Elastic Search plugin release : RSS River 0.0.1.

 

As you could imagine, RSS river plugin gets RSS feed and index some few fields such as title and description.

 

A short documentation is available : https://github.com/dadoonet/rssriver/blob/master/README.textile

Project is here : https://github.com/dadoonet/rssriver

 

To use it :

1)      Install plugin

2)      Create index for rss feed

3)      Create RSSRiver

4)      Start searching…

$ bin\plugin -install dadoonet/rssriver/0.0.1

$ curl -XPUT 'http://localhost:9200/lemonde/' -d '{}'
$ curl -XPUT 'http://localhost:9200/_river/lemonde/_meta' -d '{
  "type": "rss",
  "rss": {
    "url": "http://www.lemonde.fr/rss/une.xml"
  }
}'
$ curl –XGET 'http://localhost:9200/lemonde/_search?q=taxe'

It’s only the first release so many things to add again and many tests to do…

 

Please feel free to contribute as a tester or a developer…

 

Hope this could help someone !

 

David

http://twitter.com/dadoonet

 

Reply | Threaded
Open this post in threaded view
|

Re: [ANN] RSS River Plugin

Ivan Brusic
Very nice!

Did not know about EsExecutors. Very good to know.

Ivan

On Wed, Sep 14, 2011 at 4:05 PM, David Pilato <[hidden email]> wrote:

> Hi all,
>
>
>
>
>
> I’m happy to share with the ES community my first Elastic Search plugin
> release : RSS River 0.0.1.
>
>
>
> As you could imagine, RSS river plugin gets RSS feed and index some few
> fields such as title and description.
>
>
>
> A short documentation is available :
> https://github.com/dadoonet/rssriver/blob/master/README.textile
>
> Project is here : https://github.com/dadoonet/rssriver
>
>
>
> To use it :
>
> 1)      Install plugin
>
> 2)      Create index for rss feed
>
> 3)      Create RSSRiver
>
> 4)      Start searching…
>
> $ bin\plugin -install dadoonet/rssriver/0.0.1
>
> $ curl -XPUT 'http://localhost:9200/lemonde/' -d '{}'
>
> $ curl -XPUT 'http://localhost:9200/_river/lemonde/_meta' -d '{
>
>   "type": "rss",
>
>   "rss": {
>
>     "url": "http://www.lemonde.fr/rss/une.xml"
>
>   }
>
> }'
>
> $ curl –XGET 'http://localhost:9200/lemonde/_search?q=taxe'
>
> It’s only the first release so many things to add again and many tests to
> do…
>
>
>
> Please feel free to contribute as a tester or a developer…
>
>
>
> Hope this could help someone !
>
>
>
> David
>
> http://twitter.com/dadoonet
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [ANN] RSS River Plugin

kimchy
Administrator
In reply to this post by dadoonet
Hi David, looks great. Way back when I needed to do some RSS, and used Rome which is supposed to handle all kind of formats and the like, might simplify the code?: http://java.net/projects/rome/.

On Wed, Sep 14, 2011 at 11:05 PM, David Pilato <[hidden email]> wrote:

Hi all,

 

 

I’m happy to share with the ES community my first Elastic Search plugin release : RSS River 0.0.1.

 

As you could imagine, RSS river plugin gets RSS feed and index some few fields such as title and description.

 

A short documentation is available : https://github.com/dadoonet/rssriver/blob/master/README.textile

Project is here : https://github.com/dadoonet/rssriver

 

To use it :

1)      Install plugin

2)      Create index for rss feed

3)      Create RSSRiver

4)      Start searching…

$ bin\plugin -install dadoonet/rssriver/0.0.1

$ curl -XPUT 'http://localhost:9200/lemonde/' -d '{}'
$ curl -XPUT 'http://localhost:9200/_river/lemonde/_meta' -d '{
  "type": "rss",

  "rss": {
    "url": "http://www.lemonde.fr/rss/une.xml"
  }
}'

$ curl –XGET 'http://localhost:9200/lemonde/_search?q=taxe'

It’s only the first release so many things to add again and many tests to do…

 

Please feel free to contribute as a tester or a developer…

 

Hope this could help someone !

 

David

http://twitter.com/dadoonet

 


Reply | Threaded
Open this post in threaded view
|

RE: [ANN] RSS River Plugin

dadoonet

That was a very good advice…

New version 0.0.2 is now out with Rome. It opens many new perspectives and make the RSS River plugin stronger…

 

Thanks Shay !

 

De : [hidden email] [mailto:[hidden email]] De la part de Shay Banon
Envoyé : jeudi 15 septembre 2011 11:30
À : [hidden email]
Objet : Re: [ANN] RSS River Plugin

 

Hi David, looks great. Way back when I needed to do some RSS, and used Rome which is supposed to handle all kind of formats and the like, might simplify the code?: http://java.net/projects/rome/.