Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

deepakas
Is there a way to set marvel to delete the marvel indices after 7 days. It looks like Marvel is generating around 2 GB of data everyday.  Our disk got full 2 times because of Marvel data. Is there a way to reduce the amount of data generated by marvel ?

Also is there any plan to add alert mechanisms in Marvel.
For example if the Marvel status goto red it will be good to get an email for a specified user. I see Marvel status as red. But it doesnt show why it is causing red.  It will be good to get some alerts with the details when the cluster status goes red.
Reply | Threaded
Open this post in threaded view
|

Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

Ivan Brusic
I do not use Marvel, but another monitoring system built on top of Elasticsearch. I use the Elasticsearch Curactor to delete old indices: https://github.com/elasticsearch/curator 

I have a cron entry to run the curator once per day. Perhaps something already exists in Marvel, not sure since I am not a user.

Cheers,

Ivan



On Mon, May 12, 2014 at 7:39 AM, deepakas <[hidden email]> wrote:
Is there a way to set marvel to delete the marvel indices after 7 days. It
looks like Marvel is generating around 2 GB of data everyday.  Our disk got
full 2 times because of Marvel data. Is there a way to reduce the amount of
data generated by marvel ?

Also is there any plan to add alert mechanisms in Marvel.
For example if the Marvel status goto red it will be good to get an email
for a specified user. I see Marvel status as red. But it doesnt show why it
is causing red.  It will be good to get some alerts with the details when
the cluster status goes red.



--
View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1399905548133-4055729.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAq93AUa76%2BShoYdzRMVSq-m5Qzi%2B3utcdyaErRhA0FkA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

Boaz Leskes
Hi,

Ivan's advice is correct. Currently, curator is the way to go. There is also talk about building an index level TTL in elasticsearch but this is not reality yet.

As to reducing data - first question is whether your using version 1.1.X of marvel - this one has greatly reduced the data signature. If not, upgrading would be the easiest option. O.w. you can also look at the interval settings in the agent. You can get it up to 30s if you want to.

At the moment there is no alerting built into Marvel. You can use the marvel data & easily write a nagios script (or similar) to add it to your monitoring data.

Regarding RED status explanations - working on it - watch for the upcoming release :)

Cheers,
Boaz

On Monday, May 12, 2014 10:30:00 PM UTC+2, Ivan Brusic wrote:
I do not use Marvel, but another monitoring system built on top of Elasticsearch. I use the Elasticsearch Curactor to delete old indices: <a href="https://github.com/elasticsearch/curator" target="_blank" onmousedown="this.href='https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2Felasticsearch%2Fcurator\46sa\75D\46sntz\0751\46usg\75AFQjCNH7JbgtCZMf960Ul-YMOkFD_69WhQ';return true;" onclick="this.href='https://www.google.com/url?q\75https%3A%2F%2Fgithub.com%2Felasticsearch%2Fcurator\46sa\75D\46sntz\0751\46usg\75AFQjCNH7JbgtCZMf960Ul-YMOkFD_69WhQ';return true;">https://github.com/elasticsearch/curator 

I have a cron entry to run the curator once per day. Perhaps something already exists in Marvel, not sure since I am not a user.

Cheers,

Ivan



On Mon, May 12, 2014 at 7:39 AM, deepakas <[hidden email]> wrote:
Is there a way to set marvel to delete the marvel indices after 7 days. It
looks like Marvel is generating around 2 GB of data everyday.  Our disk got
full 2 times because of Marvel data. Is there a way to reduce the amount of
data generated by marvel ?

Also is there any plan to add alert mechanisms in Marvel.
For example if the Marvel status goto red it will be good to get an email
for a specified user. I see Marvel status as red. But it doesnt show why it
is causing red.  It will be good to get some alerts with the details when
the cluster status goes red.



--
View this message in context: <a href="http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729.html" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729.html\46sa\75D\46sntz\0751\46usg\75AFQjCNGna-8e_aMrMQhozCR9P5nAzCtoNA';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729.html\46sa\75D\46sntz\0751\46usg\75AFQjCNGna-8e_aMrMQhozCR9P5nAzCtoNA';return true;">http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/elasticsearch/1399905548133-4055729.post%40n3.nabble.com" target="_blank" onmousedown="this.href='https://groups.google.com/d/msgid/elasticsearch/1399905548133-4055729.post%40n3.nabble.com';return true;" onclick="this.href='https://groups.google.com/d/msgid/elasticsearch/1399905548133-4055729.post%40n3.nabble.com';return true;">https://groups.google.com/d/msgid/elasticsearch/1399905548133-4055729.post%40n3.nabble.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" onmousedown="this.href='https://groups.google.com/d/optout';return true;" onclick="this.href='https://groups.google.com/d/optout';return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c446d35c-c3e5-4c5e-91e4-09f39c3e4b42%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

deepakas
Hi Ivan/Boaz,

Thanks for the responses. I will checkout Curator. I already got the latest version of marvel last week using this command.
bin/plugin -i elasticsearch/marvel/latest

Thanks, Deepak
Reply | Threaded
Open this post in threaded view
|

Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

deepakas
Hi Ivan/Boaz,

I am getting some warning when I tried to delete the marvel index using curator. 

github]#  /usr/lib/python2.6/site-packages/curator/curator.py  -d 3 -p .marvel
2014-05-14T18:07:44.691 INFO                        main:333  Job starting...
2014-05-14T18:07:44.692 INFO                   _new_conn:180  Starting new HTTP connection (1): localhost
2014-05-14T18:07:44.694 INFO         log_request_success:49   GET http://localhost:9200/ [status:200 request:0.003s]
2014-05-14T18:07:44.695 INFO                        main:359  Deleting indices older than 3 days...
2014-05-14T18:07:44.698 INFO         log_request_success:49   GET http://localhost:9200/.marvel*/_settings?expand_wildcards=closed [status:200 request:0.002s]
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.07
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.08
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.09
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.10
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.11
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.12
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.13
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.14
2014-05-14T18:07:44.723 INFO                  index_loop:309  DELETE index operations completed.
2014-05-14T18:07:44.723 INFO                        main:379  Done in 0:00:00.037963.
[root@node05 github]# ls -ltr /var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel*
/var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel-2014.05.10:
total 8
drwxr-xr-x. 2 elasticsearch elasticsearch 4096 May 10 01:00 _state
drwxr-xr-x. 5 elasticsearch elasticsearch 4096 May 10 01:00 0

/var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel-2014.05.11:

Any thoughts?


On Tue, May 13, 2014 at 12:26 PM, deepakas [via ElasticSearch Users] <[hidden email]> wrote:
Hi Ivan/Boaz,

Thanks for the responses. I will checkout Curator. I already got the latest version of marvel last week using this command.
bin/plugin -i elasticsearch/marvel/latest

Thanks, Deepak


To unsubscribe from Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?, click here.
NAML



--
Deepak Subhramanian
Reply | Threaded
Open this post in threaded view
|

Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

Gokul
Deepak, 

Can you try the command with a hyphen at the end -   /usr/lib/python2.6/site-packages/curator/curator.py  -d 3 -p .marvel-
For some reason, curator doesn't match the marvel indices when using ".marvel" as the prefix.




Regards,


On Thursday, May 15, 2014 1:14:14 AM UTC+8, Deepak Subhramanian wrote:
Hi Ivan/Boaz,

I am getting some warning when I tried to delete the marvel index using curator. 

github]#  /usr/lib/python2.6/site-packages/curator/curator.py  -d 3 -p .marvel
2014-05-14T18:07:44.691 INFO                        main:333  Job starting...
2014-05-14T18:07:44.692 INFO                   _new_conn:180  Starting new HTTP connection (1): localhost
2014-05-14T18:07:44.694 INFO         log_request_success:49   GET <a href="http://localhost:9200/" rel="nofollow" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Flocalhost%3A9200%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNFZm0uXsskbuhdXxWiFGnlSJ5lZFQ';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Flocalhost%3A9200%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNFZm0uXsskbuhdXxWiFGnlSJ5lZFQ';return true;">http://localhost:9200/ [status:200 request:0.003s]
2014-05-14T18:07:44.695 INFO                        main:359  Deleting indices older than 3 days...
2014-05-14T18:07:44.698 INFO         log_request_success:49   GET <a href="http://localhost:9200/.marvel*/_settings?expand_wildcards=closed" rel="nofollow" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Flocalhost%3A9200%2F.marvel*%2F_settings%3Fexpand_wildcards%3Dclosed\46sa\75D\46sntz\0751\46usg\75AFQjCNELmx23jXDWpOvPrJ5W7cZ0PCxDDA';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Flocalhost%3A9200%2F.marvel*%2F_settings%3Fexpand_wildcards%3Dclosed\46sa\75D\46sntz\0751\46usg\75AFQjCNELmx23jXDWpOvPrJ5W7cZ0PCxDDA';return true;">http://localhost:9200/.marvel*/_settings?expand_wildcards=closed [status:200 request:0.002s]
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.07
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.08
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.09
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.10
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.11
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.12
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.13
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.14
2014-05-14T18:07:44.723 INFO                  index_loop:309  DELETE index operations completed.
2014-05-14T18:07:44.723 INFO                        main:379  Done in 0:00:00.037963.
[root@node05 github]# ls -ltr /var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel*
/var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel-2014.05.10:
total 8
drwxr-xr-x. 2 elasticsearch elasticsearch 4096 May 10 01:00 _state
drwxr-xr-x. 5 elasticsearch elasticsearch 4096 May 10 01:00 0

/var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel-2014.05.11:

Any thoughts?


On Tue, May 13, 2014 at 12:26 PM, deepakas [via ElasticSearch Users] <<a href="http://user/SendEmail.jtp?type=node&amp;node=4055895&amp;i=0" rel="nofollow" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Fuser%2FSendEmail.jtp%3Ftype%3Dnode%26node%3D4055895%26i%3D0\46sa\75D\46sntz\0751\46usg\75AFQjCNEZSNOl6_EPEQGeQRUfdItzqyqimw';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Fuser%2FSendEmail.jtp%3Ftype%3Dnode%26node%3D4055895%26i%3D0\46sa\75D\46sntz\0751\46usg\75AFQjCNEZSNOl6_EPEQGeQRUfdItzqyqimw';return true;">[hidden email]> wrote:
Hi Ivan/Boaz,

Thanks for the responses. I will checkout Curator. I already got the latest version of marvel last week using this command.
bin/plugin -i elasticsearch/marvel/latest

Thanks, Deepak


If you reply to this email, your message will be added to the discussion below:
<a href="http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html" rel="nofollow" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHVASlou8ATr7a7QtGdOlVgeSmU9w';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHVASlou8ATr7a7QtGdOlVgeSmU9w';return true;">http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html
To unsubscribe from Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?, click here.
<a href="http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&amp;id=instant_html%21nabble%3Aemail.naml&amp;base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&amp;breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml" rel="nofollow" style="font:9px serif" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2Ftemplate%2FNamlServlet.jtp%3Fmacro%3Dmacro_viewer%26id%3Dinstant_html%2521nabble%253Aemail.naml%26base%3Dnabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace%26breadcrumbs%3Dnotify_subscribers%2521nabble%253Aemail.naml-instant_emails%2521nabble%253Aemail.naml-send_instant_email%2521nabble%253Aemail.naml\46sa\75D\46sntz\0751\46usg\75AFQjCNHHPUEFLwuSlwHe9QJtyQjgi3Rg1A';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2Ftemplate%2FNamlServlet.jtp%3Fmacro%3Dmacro_viewer%26id%3Dinstant_html%2521nabble%253Aemail.naml%26base%3Dnabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace%26breadcrumbs%3Dnotify_subscribers%2521nabble%253Aemail.naml-instant_emails%2521nabble%253Aemail.naml-send_instant_email%2521nabble%253Aemail.naml\46sa\75D\46sntz\0751\46usg\75AFQjCNHHPUEFLwuSlwHe9QJtyQjgi3Rg1A';return true;">NAML



--
Deepak Subhramanian


View this message in context: <a href="http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055895.html" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055895.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHB_DEJ-gpWIe1TdxF1CZNavWlO3g';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055895.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHB_DEJ-gpWIe1TdxF1CZNavWlO3g';return true;">Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?
Sent from the <a href="http://elasticsearch-users.115913.n3.nabble.com/" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEgc-fdLu8oOpYLOP_2BGtFRus0Uw';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEgc-fdLu8oOpYLOP_2BGtFRus0Uw';return true;">ElasticSearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/36baa5ec-c467-47df-b597-0aee612dd888%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?

deepakas
Thanks Gokul. It worked after adding the hyphen. 


On Mon, May 19, 2014 at 3:25 AM, Gokul A [via ElasticSearch Users] <[hidden email]> wrote:
Deepak, 

Can you try the command with a hyphen at the end -   /usr/lib/python2.6/site-packages/curator/curator.py  -d 3 -p .marvel-
For some reason, curator doesn't match the marvel indices when using ".marvel" as the prefix.




Regards,


On Thursday, May 15, 2014 1:14:14 AM UTC+8, Deepak Subhramanian wrote:
Hi Ivan/Boaz,

I am getting some warning when I tried to delete the marvel index using curator. 

github]#  /usr/lib/python2.6/site-packages/curator/curator.py  -d 3 -p .marvel
2014-05-14T18:07:44.691 INFO                        main:333  Job starting...
2014-05-14T18:07:44.692 INFO                   _new_conn:180  Starting new HTTP connection (1): localhost
2014-05-14T18:07:44.694 INFO         log_request_success:49   GET <a href="http://localhost:9200/" rel="nofollow" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Flocalhost%3A9200%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNFZm0uXsskbuhdXxWiFGnlSJ5lZFQ';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Flocalhost%3A9200%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNFZm0uXsskbuhdXxWiFGnlSJ5lZFQ';return true;">http://localhost:9200/ [status:200 request:0.003s]
2014-05-14T18:07:44.695 INFO                        main:359  Deleting indices older than 3 days...
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.07
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.08
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.09
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.10
2014-05-14T18:07:44.722 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.11
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.12
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.13
2014-05-14T18:07:44.723 ERROR       find_expired_indices:201  Could not find a valid timestamp from the index: .marvel-2014.05.14
2014-05-14T18:07:44.723 INFO                  index_loop:309  DELETE index operations completed.
2014-05-14T18:07:44.723 INFO                        main:379  Done in 0:00:00.037963.
[root@node05 github]# ls -ltr /var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel*
/var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel-2014.05.10:
total 8
drwxr-xr-x. 2 elasticsearch elasticsearch 4096 May 10 01:00 _state
drwxr-xr-x. 5 elasticsearch elasticsearch 4096 May 10 01:00 0

/var/lib/elasticsearch/bigdatadev/nodes/0/indices/.marvel-2014.05.11:

Any thoughts?


Hi Ivan/Boaz,

Thanks for the responses. I will checkout Curator. I already got the latest version of marvel last week using this command.
bin/plugin -i elasticsearch/marvel/latest

Thanks, Deepak


If you reply to this email, your message will be added to the discussion below:
<a href="http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html" rel="nofollow" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHVASlou8ATr7a7QtGdOlVgeSmU9w';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHVASlou8ATr7a7QtGdOlVgeSmU9w';return true;">http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055784.html
To unsubscribe from Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?, click here.
<a href="http://elasticsearch-users.115913.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&amp;id=instant_html%21nabble%3Aemail.naml&amp;base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&amp;breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml" rel="nofollow" style="font:9px serif" link="external" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2Ftemplate%2FNamlServlet.jtp%3Fmacro%3Dmacro_viewer%26id%3Dinstant_html%2521nabble%253Aemail.naml%26base%3Dnabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace%26breadcrumbs%3Dnotify_subscribers%2521nabble%253Aemail.naml-instant_emails%2521nabble%253Aemail.naml-send_instant_email%2521nabble%253Aemail.naml\46sa\75D\46sntz\0751\46usg\75AFQjCNHHPUEFLwuSlwHe9QJtyQjgi3Rg1A';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2Ftemplate%2FNamlServlet.jtp%3Fmacro%3Dmacro_viewer%26id%3Dinstant_html%2521nabble%253Aemail.naml%26base%3Dnabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace%26breadcrumbs%3Dnotify_subscribers%2521nabble%253Aemail.naml-instant_emails%2521nabble%253Aemail.naml-send_instant_email%2521nabble%253Aemail.naml\46sa\75D\46sntz\0751\46usg\75AFQjCNHHPUEFLwuSlwHe9QJtyQjgi3Rg1A';return true;">NAML



--
Deepak Subhramanian


View this message in context: <a href="http://elasticsearch-users.115913.n3.nabble.com/Marvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055895.html" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055895.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHB_DEJ-gpWIe1TdxF1CZNavWlO3g';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2FMarvel-Indices-taking-lot-of-space-Can-we-specify-automatic-delete-of-marvel-indice-tp4055729p4055895.html\46sa\75D\46sntz\0751\46usg\75AFQjCNHB_DEJ-gpWIe1TdxF1CZNavWlO3g';return true;">Re: Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?
Sent from the <a href="http://elasticsearch-users.115913.n3.nabble.com/" target="_blank" onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEgc-fdLu8oOpYLOP_2BGtFRus0Uw';return true;" onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Felasticsearch-users.115913.n3.nabble.com%2F\46sa\75D\46sntz\0751\46usg\75AFQjCNEgc-fdLu8oOpYLOP_2BGtFRus0Uw';return true;">ElasticSearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/36baa5ec-c467-47df-b597-0aee612dd888%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



To unsubscribe from Marvel Indices taking lot of space ? Can we specify automatic delete of marvel indice ?, click here.
NAML



--
Deepak Subhramanian