It is possible to determine cache hit rate per node or per query. Per node, you can see hit rate by looking at LLAP metrics view (<llap node>:15002, see General debugging):
Per query, it is possible to see LLAP IO counters (including hit rate) upon running the query by setting hive.tez.exec.print.summary=true, which should produce the counters output at the end of the query, for example - empty cache:
Some data in cache:
Investigating when the queries on LLAP are slow or stuck
LLAP debugging overview - logs, UIs, etc
Investigating when LLAP doesn’t start
Hive on Tez Performance Tuning - Determining Reducer Counts
More Hadoop nodes = faster IO and processing time?
LLAP troubleshooting and debugging
Part 1 - Ad-hoc Query Workloads on HDP
Integrating Apache Hive with Apache Spark - Hive Warehouse Connector
How to Use Hortonworks Cloud to provision a cluster and experiment with Hive LLAP
This website uses cookies for analytics, personalisation and advertising. To learn more or change your cookie settings, please read our Cookie Policy. By continuing to browse, you agree to our use of cookies.
HCC Guidelines | HCC FAQs | HCC Privacy Policy | Privacy Policy | Terms of Service
© 2011-2019 Hortonworks Inc. All Rights Reserved.
Hadoop, Falcon, Atlas, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie and the Hadoop elephant logo are trademarks of the Apache Software Foundation.