hadoop报错总结01

2023-06-29 14:55:09 浏览数 (1)

1.进行矩阵计算的时候,由于持续时间长,往往会出现超时的错误,错误内容如下: INFO mapreduce.Job: Task Id : attempt_1422500209602_0008_m_000000_0, Status : FAILED

AttemptID:attempt_1422500209602_0008_m_000000_0 Timed out after 600 secs

有两种办法可以修复

1)解决办法是在代码中定时report  context.progress();

2)in mapred-site.xml添加或者修改

 mapred.task.timeout

  1800000

2.You have an error in your SQL syntax; check the manual that corresponds to your MySQL serv

er version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1

Mysql-connector-java.jar版本太低,方法不支持

3.Current usage: 280.1 MB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual me

mory used. Killing container.

清除jvm

Jvm分配情况,清除mapred-site.xml配置

<property>

   <name>mapred.child.java.opts</name>

   <value>-Xmx1024m</value>

 </property>

这个配置影响

0 人点赞