is running 236038656B beyond the 'VIRTUAL' memory limit. Current usage: 52.4 MB of 1 GB ph


[2022-03-18 18:26:57.187]Container [pid=92959,containerID=container_1647598528227_0003_01_000002]
is running 236038656B beyond the 'VIRTUAL' memory limit. Current usage: 52.4 MB of 1 GB physical
memory used; 2.3 GB of 2.1 GB virtual memory used. Killing container.

输入下列代码时报以上错误

hadoop jar wc.jar com.ltj.wordcount.WordCount -Dmapreduce.job.queuename=default /input /output

问题原因是container在申请多余的内存时,被resouremanager杀掉了
此处可修改hadoop/etc/mapred-site.xml
添加配置信息


  mapreduce.map.memory.mb
  1536


  mapreduce.map.java.opts
  -Xmx1024M


  mapreduce.reduce.memory.mb
  3072


  mapreduce.reduce.java.opts
  -Xmx2560M

然后重启hadoop
重新提交任务

找了一天-----555终于解决了