下表列出了Cloudera Manager部署中各种服务之间存在的服务依赖关系。
为生产环境配置CDP Runtime时,请确保启用Kerberos进行用户身份验证。当Cloudera在启用了Kerberos的用户进行身份验证的群集上运行时,它们支持Ranger和Atlas等安全服务。
表1.服务依赖性
服务 |
依赖 |
可选依赖 |
ADLS Connector |
||
Atlas |
HDFS HBase Kafka (仅依赖Kafka broker角色) Solr |
Ranger |
Cruise Control |
Kafka Zookeeper |
|
Data Context Connector |
||
HBase |
HDFS ZooKeeper |
Atlas Ranger |
HDFS |
ADLS Connector 或 Ranger ZooKeeper |
|
Hive |
HDFS |
Atlas HBase Kudu Ranger Spark on YARN YARN ZooKeeper |
Hive-on-Tez |
HDFS Hive Tez |
Atlas HBase Ranger YARN ZooKeeper |
Hue |
HDFS Hive |
Atlas HBase Hive-on-Tez Impala Oozie Solr ZooKeeper |
Impala |
HDFS Hive |
Atlas HBase Kudu Ranger YARN ZooKeeper |
Kafka |
ZooKeeper |
HDFS Ranger |
Key-Value Store Indexer |
HBase Solr |
Ranger |
Kudu |
Ranger |
|
Livy |
Spark-on-YARN YARN |
Hive |
Oozie |
YARN |
Hive Spark on YARN ZooKeeper |
Ozone |
HDFS Ranger |
|
Ranger |
HBase HDFS Kafka Solr |
|
S3 Connector |
||
Schema Registry |
HDFS Ranger |
|
Solr |
HDFS ZooKeeper |
Ranger |
Spark on YARN |
YARN |
Atlas HBase |
Streams Messaging Manager |
Kafka |
Ranger Schema Registry Zookeeper |
Streams Replication Manager |
Kafka |
|
Tez |
YARN |
|
YARN |
HDFS ZooKeeper |
Ranger |
Zeppelin |
HDFS Spark-on-YARN YARN |
Livy |
ZooKeeper |
点击链接参与阿里云CDP限时免费测试啦~
https://survey.aliyun.com/apps/zhiliao/owtTaIQU3
钉钉扫描下方二维码加入阿里云 Cloudera 企业数据云交流群一起参与讨论吧!