Hive – big data – big problems

By | July 26, 2017

2017-07-26 00:32:04,676 INFO [communication thread] org.apache.hadoop.mapred.Task: Communication exception: java.lang.OutOfMemoryError: GC overhead limit exceeded
	at java.util.Arrays.copyOfRange(Arrays.java:3664)
	at java.lang.String.<init>(String.java:207)
	at java.lang.String.substring(String.java:1933)
	at java.io.File.getName(File.java:456)
	at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:243)
	at java.io.File.isDirectory(File.java:849)
	at org.apache.hadoop.yarn.util.ProcfsBasedProcessTree.getProcessList(ProcfsBasedProcessTree.java:511)
	at org.apache.hadoop.yarn.util.ProcfsBasedProcessTree.updateProcessTree(ProcfsBasedProcessTree.java:210)
	at org.apache.hadoop.mapred.Task.updateResourceCounters(Task.java:894)
	at org.apache.hadoop.mapred.Task.updateCounters(Task.java:1045)
	at org.apache.hadoop.mapred.Task.access(Task.java:82)
	at org.apache.hadoop.mapred.Task$TaskReporter.run(Task.java:782)
	at java.lang.Thread.run(Thread.java:745)

Leave a Reply

Your email address will not be published. Required fields are marked *