CDH报错:Resource management is disabled for host cdh03 but at least one of its roles has cgroup parame

2021-04-27 11:55:29 浏览数 (1)

问题描述

Resource management is disabled for host cdh03 but at least one of its roles has cgroup parame

问题解决

(1)CDH进入YARN配置页面,搜索 cgroup ,将以下两个选项配置勾选

将 CGroups 用于资源管理  yarn.nodemanager.linux-container-executor.resources-handler.class 始终使用 Linux Container Executor  yarn.nodemanager.container-executor.class

(2)开启后保存时发现需要启用Cgroup 资源管理配置

(3)couldear主界面点击 主机 - 所有主机 ,然后点击每一台服务器

(4)进入配置选项,找到 "启用基于 Cgroup 的资源管理" 选项,勾选 - 保存 - (每一台主机)

官方说明

Configuration Name

Description

yarn.nodemanager.container-executor.class

This should be set to “org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor”. CGroups is a Linux kernel feature and is exposed via the LinuxContainerExecutor.

yarn.nodemanager.linux-container-executor.resources-handler.class

This should be set to “org.apache.hadoop.yarn.server.nodemanager.util.CgroupsLCEResourcesHandler”. Using the LinuxContainerExecutor doesn’t force you to use CGroups. If you wish to use CGroups, the resource-handler-class must be set to CGroupsLCEResourceHandler.

问题总结

Cgroup 是Linux 提供给一组进程及将来子进程的资源(CPU、内存、存储、网络)限制、控制和统计的能力。 配置上文的两个YARN选项可以将Cgroup权限交由给Yarn管理,Yarn可以更灵活的调用Linux资源。

0 人点赞