Logging in HDInsight

Debarchan Sarkar · Apress eBooks · 2014

A complex eco system like Hadoop must have a detailed logging mechanism to fall back on in case something goes wrong. In traditional Hadoop, all the services—like NameNode, JobTracker, TaskTracker, and so on—have logging capabilities where each and every operation is logged right from service startup to shut down. Apart from the services or daemons startup, there are additional events that need to be recorded, such as job requests, interprocess communication between the services, job execution history, and others.

Read the paper · More papers on PaperTik