Saw the following in the master logs on a secure cluster.
Afterwards, could not find the file it was complaining about on hdfs. I think the jar is temporarily placed there when a mapreduce job is run, which can cause this exception to occur if the janitor happens to run at that time. Nothing bad comes of it, but we should handle that scenario.
Looks like something very wrong. The StreamFileJanitor should only looks under the stream directories.
going to restructure directories so that namespace is one level lower