Not all YARN events visible through UI logs viewer.
Description
Some log events are not sent to the CDAP UI for viewing. As a result, the app master container has to be killed to view all of the YARN logs. This is not optimal for a production environment that requires support by viewing log events.
Specifically, our TransactionService container reported it was running beyond physical memory limits, though this log event was not visible anywhere outside the YARN logs.
Here is the exception:
04:47:26.724 [ApplicationMasterService] INFO o.a.t.i.a.ApplicationMasterService - Container container_e76_1487862040010_343197_01_000026 completed with COMPLETE:Container [pid=24852, containerID=container_e76_1487862040010_343197_01_000026] is running beyond physical memory limits. Current usage: 16.1 GB of 16 GB physical memory used; 18.1 GB of 33.6 GB virtual me mory used. Killing container.
Some log events are not sent to the CDAP UI for viewing. As a result, the app master container has to be killed to view all of the YARN logs. This is not optimal for a production environment that requires support by viewing log events.
Specifically, our TransactionService container reported it was running beyond physical memory limits, though this log event was not visible anywhere outside the YARN logs.
Here is the exception:
04:47:26.724 [ApplicationMasterService] INFO o.a.t.i.a.ApplicationMasterService - Container container_e76_1487862040010_343197_01_000026 completed with COMPLETE:Container [pid=24852,
containerID=container_e76_1487862040010_343197_01_000026] is running beyond physical memory limits. Current usage: 16.1 GB of 16 GB physical memory used; 18.1 GB of 33.6 GB virtual me
mory used. Killing container.