What is a reasonable number of evictions for filter_cache and fielddata?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

What is a reasonable number of evictions for filter_cache and fielddata?

Gavin Seng


Graphs: http://i.imgur.com/HjlGX4w.png

* Wanted to share our cache evictions/size for filter_cache and fielddata and see what others are getting just for sanity checks.
* The above is for one of our hot nodes.
  * Machine:128GB JVM:96GB
  * indices.fielddata.cache.size: 31GB
  * indices.cache.filter.size: 8GB
  * indices.fielddata.cache.expire: not set because of http://www.elastic.co/guide/en/elasticsearch/guide/current/_limiting_memory_usage.html#f│
* Our data is logs and most queries are of type now-x {min,hour,days}.
* Most of these come off kibana 3 which uses specific unix timestamps in the filter so we can't really do this http://www.elastic.co/guide/en/elasticsearch/guide/current/_filter_order.html w/o patching it.
* We index about 20GB/hr peak and about 4GB/hr non-peak.

Thanks in advance for sharing your numbers.


You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9c88c077-5884-4b72-93da-d126805884e2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

es_cache.png (131K) Download Attachment