Spark集成Kudu(Spaek shell)

[root@centos00 spark-2.2.1-cdh5.14.2]# bin/spark-shell --master local[2]  --packages org.apache.kudu:kudu-spark2_2.11:1.8.0
Ivy Default Cache set to: /root/.ivy2/cache
The jars for the packages stored in: /root/.ivy2/jars
:: loading settings :: url = jar:file:/opt/cdh5.14.2/spark-2.2.1-cdh5.14.2/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
org.apache.kudu#kudu-spark2_2.11 added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0
	confs: [default]
	found org.apache.kudu#kudu-spark2_2.11;1.8.0 in central
:: resolution report :: resolve 154ms :: artifacts dl 1ms
	:: modules in use:
	org.apache.kudu#kudu-spark2_2.11;1.8.0 from central in [default]
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent
	confs: [default]
	0 artifacts copied, 1 already retrieved (0kB/4ms)
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
20/09/08 13:07:50 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
20/09/08 13:07:52 WARN util.Utils: Service ‘SparkUI‘ could not bind on port 4040. Attempting port 4041.
Spark context Web UI available at http://192.168.208.3:4041
Spark context available as ‘sc‘ (master = local[2], app id = local-1599538072360).
Spark session available as ‘spark‘.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  ‘_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.2.1
      /_/
         
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_112)
Type in expressions to have them evaluated.
Type :help for more information.

scala> 

  

Spark集成Kudu(Spaek shell)

上一篇:如何在Linux/Unix上使用ssh-agent进行身份验证


下一篇:《循序渐进Linux(第2版) 基础知识 服务器搭建 系统管理 性能调优 虚拟化与集群应用》——2.2 Linux的几种安装方式