What are the background process to monitor the HDFS and Namenode health check
Answer by Mridul Mishra · Dec 13, 2017 at 08:48 PM
you may check the process id of namenode through jps command on the master node and also datanode process on slave nodes and check for the process state using ps command.
Kindly use hdfs user superuser (hdfs) to run jps command. Also you may need to install jps binary if it's not already installed.
If you want to monitor you may schedule cron scripts to monitor the process so that it can give you alerts via email/sms.
by JPS command we can check which are hadoop service runing on cluster, i am looking what background/Daemon process in responsible for monitoring the Health check of HDFS
Following Demons : 0n hadoop cluster.
3 Daemons run on Master nodes:
NameNode – This daemon stores and maintains the metadata for HDFS.
Secondary NameNode – Performs housekeeping functions for the NameNode.
JobTracker/RM/YARN – Manages MapReduce jobs, distributes individual tasks to machines running the Task Tracker.
2 Daemons run on Slave nodes:
DataNode – Stores actual HDFS data blocks.
TaskTracker/Application Master – Responsible for instantiating and monitoring individual Map and Reduce tasks.
HCC Guidelines | HCC FAQs | HCC Privacy Policy
© 2011-2017 Hortonworks Inc. All Rights Reserved.
Hadoop, Falcon, Atlas, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie and the Hadoop elephant logo are trademarks of the Apache Software Foundation.
Privacy Policy |
Terms of Service
HCC Guidelines | HCC FAQs | HCC Privacy Policy | Privacy Policy | Terms of Service
© 2011-2018 Hortonworks Inc. All Rights Reserved.
Hadoop, Falcon, Atlas, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie and the Hadoop elephant logo are trademarks of the Apache Software Foundation.