安装HUE之后,需要配置很多东西才能将这个系统的功能发挥出来,因为Yarn是配置的HA模式,所以在配置HUE的时候,会有些不用,下面一段文字是官网拿来的
# Configuration for YARN (MR2)
# ------------------------------------------------------------------------
[[yarn_clusters]] [[[default]]] # Whether to submit jobs to this cluster
submit_to=True # Name used when submitting jobs
logical_name=ha-rm # URL of the ResourceManager API
resourcemanager_api_url=http://gethue-.com: # URL of the ProxyServer API
proxy_api_url=http://gethue-.com: # URL of the HistoryServer API
history_server_api_url=http://gethue-.com: [[[ha]]]
# Enter the host on which you are running the failover Resource Manager
resourcemanager_api_url=http://gethue-.com:
logical_name=ha-rm
submit_to=True
这里需要说明一下,[[[default]]] 和 [[ha]]中各配置一个RM,logical_name名字就是yarn-site.xml中配置的
<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
URL of the ResourceManager API 这里配置资源管理的地址和端口,对应yarn-site.xml中的
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>-:</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm2</name>
<value>-:</value>
</property>
URL of the HistoryServer API 这里配置历史记录资源管理的地址和端口,对应mapred-site.xml中的
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>-:</value>
</property>
我的配置文件如下:
[[yarn_clusters]] [[[default]]]
# Enter the host on which you are running the ResourceManager
## resourcemanager_host=localhost # The port where the ResourceManager IPC listens on
## resourcemanager_port=8032 # Whether to submit jobs to this cluster
submit_to=True # Resource Manager logical name (required for HA)
logical_name=rm1 # Change this if your YARN cluster is Kerberos-secured
## security_enabled=false # URL of the ResourceManager API
resourcemanager_api_url=http://-: # URL of the HistoryServer API
history_server_api_url=http://-: # In secure mode (HTTPS), if SSL certificates from YARN Rest APIs
# have to be verified against certificate authority
## ssl_cert_ca_verify=True # HA support by specifying multiple clusters
# e.g. [[[ha]]]
# Resource Manager logical name (required for HA)
logical_name=rm2
resourcemanager_api_url=http://-:
history_server_api_url=http://-:
submit_to=True
参考:
http://gethue.com/hadoop-tutorial-yarn-resource-manager-high-availability-ha-in-mr2/
http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_hue_config.html
http://cloudera.github.io/hue/docs-3.8.0/manual.html#_hadoop_configuration