Hortonworks had released HDP 2.6 in Q2 2017. Isilon engineering team worked closely with Hortonworks engineering team to validate HDP 2.6 with OneFS.
One of the features of HDP 2.6 was LLAP (Long Live And Process). LLAP enables as fast as sub-second SQL analytics on Hadoop by intelligently caching data in memory with persistent servers that instantly process SQL queries.
However, please note that LLAP is officially NOT SUPPORTED with OneFS. Customers are advised NOT to use LLAP (even though it may seem to work after config changes) because it could potentially result in data inconsistency issue
Additional Details
With this configuration change, the queries will be executed and this will make LLAP technically “usable” with Isilon but will also cause potential data inconsistency issue. This is because with this capability turned off, LLAP will try to access data by filename (and not by inode path) in the filesystem, which means that the LLAP cache can potentially has an outdated file with the same filename but not knowing that there is a newer one to fetch.
Recommendation:
LLAP support with Isilon is currently planned for future release of OneFS. For more details on timing of release, contact your Isilon/Hortonworks representative
HDFS Recovery Time from Single DataNode Failure
hive Insert to Dynamic Partition query Generating too many small files
My-SQL Hive User creation and grants on it
HDP 2.5.6.0 is now released and includes about 60 Apache JIRA fixes
Why container-executor.cfg is overwritten when restarting services
Apache Kafka New Features Journey from HDP 2.2.0 to HDP 2.6.1
HCC Guidelines | HCC FAQs | HCC Privacy Policy
© 2011-2017 Hortonworks Inc. All Rights Reserved.
Hadoop, Falcon, Atlas, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie and the Hadoop elephant logo are trademarks of the Apache Software Foundation.
Privacy Policy |
Terms of Service
HCC Guidelines | HCC FAQs | HCC Privacy Policy | Privacy Policy | Terms of Service
© 2011-2018 Hortonworks Inc. All Rights Reserved.
Hadoop, Falcon, Atlas, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie and the Hadoop elephant logo are trademarks of the Apache Software Foundation.