spark集群与phoenix进行数据请求时报错：
2018-06-15 17:13:30,158 INFO - Starting task 15.3 in stage 116.0 (TID 6832, slave3, partition 15,PROCESS_LOCAL, 4309 bytes)
2018-06-15 17:13:30,160 INFO - Lost task 1.2 in stage 116.0 (TID 6805) on executor slave3: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 17]
2018-06-15 17:13:30,165 INFO - Starting task 1.3 in stage 116.0 (TID 6833, slave6, partition 1,PROCESS_LOCAL, 4517 bytes)
2018-06-15 17:13:30,168 INFO - Lost task 18.2 in stage 116.0 (TID 6793) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 18]
2018-06-15 17:13:30,168 INFO - Lost task 7.2 in stage 116.0 (TID 6810) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 19]
2018-06-15 17:13:30,171 INFO - Starting task 7.3 in stage 116.0 (TID 6834, slave6, partition 7,PROCESS_LOCAL, 4513 bytes)
2018-06-15 17:13:30,173 INFO - Starting task 18.3 in stage 116.0 (TID 6835, master2, partition 18,PROCESS_LOCAL, 4309 bytes)
2018-06-15 17:13:30,175 INFO - Lost task 16.2 in stage 116.0 (TID 6801) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 20]
2018-06-15 17:13:30,177 INFO - Starting task 16.3 in stage 116.0 (TID 6836, slave5, partition 16,PROCESS_LOCAL, 4313 bytes)
2018-06-15 17:13:30,188 INFO - Lost task 0.2 in stage 116.0 (TID 6811) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 21]
2018-06-15 17:13:30,189 INFO - Starting task 0.3 in stage 116.0 (TID 6837, slave4, partition 0,PROCESS_LOCAL, 4513 bytes)
2018-06-15 17:13:30,214 INFO - Lost task 22.2 in stage 116.0 (TID 6803) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 22]
2018-06-15 17:13:30,215 INFO - Starting task 22.3 in stage 116.0 (TID 6838, slave1, partition 22,PROCESS_LOCAL, 4309 bytes)
2018-06-15 17:13:30,216 INFO - Lost task 28.2 in stage 116.0 (TID 6814) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 23]
2018-06-15 17:13:30,217 INFO - Starting task 28.3 in stage 116.0 (TID 6839, slave6, partition 28,PROCESS_LOCAL, 4307 bytes)
2018-06-15 17:13:30,218 INFO - Lost task 26.2 in stage 116.0 (TID 6795) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 24]
2018-06-15 17:13:30,219 INFO - Starting task 26.3 in stage 116.0 (TID 6840, slave6, partition 26,PROCESS_LOCAL, 4297 bytes)
2018-06-15 17:13:30,223 INFO - Lost task 6.2 in stage 116.0 (TID 6798) on executor master2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 25]
2018-06-15 17:13:30,225 INFO - Starting task 6.3 in stage 116.0 (TID 6841, slave3, partition 6,PROCESS_LOCAL, 4517 bytes)
2018-06-15 17:13:30,225 INFO - Lost task 29.2 in stage 116.0 (TID 6809) on executor slave5: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 26]
2018-06-15 17:13:30,226 INFO - Starting task 29.3 in stage 116.0 (TID 6842, slave4, partition 29,PROCESS_LOCAL, 4309 bytes)
2018-06-15 17:13:30,272 INFO - Lost task 19.2 in stage 116.0 (TID 6815) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 27]
2018-06-15 17:13:30,273 INFO - Starting task 19.3 in stage 116.0 (TID 6843, slave4, partition 19,PROCESS_LOCAL, 4307 bytes)
2018-06-15 17:13:30,282 INFO - Lost task 5.2 in stage 116.0 (TID 6802) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 28]
2018-06-15 17:13:30,284 INFO - Starting task 5.3 in stage 116.0 (TID 6844, slave6, partition 5,PROCESS_LOCAL, 4509 bytes)
2018-06-15 17:13:30,309 INFO - Lost task 21.2 in stage 116.0 (TID 6812) on executor slave1: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 29]
2018-06-15 17:13:30,310 INFO - Starting task 21.3 in stage 116.0 (TID 6845, slave3, partition 21,PROCESS_LOCAL, 4313 bytes)
2018-06-15 17:14:18,182 WARN - Lost task 11.3 in stage 116.0 (TID 6821, slave1): java.lang.RuntimeException: org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.
at com.google.common.base.Throwables.propagate(Throwables.java:160)
at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(PhoenixRecordReader.java:138)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.<init>(NewHadoopRDD.scala:158)
at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:129)
at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:64)
at org.apache.phoenix.spark.PhoenixRDD.compute(PhoenixRDD.scala:53)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.UnionRDD.compute(UnionRDD.scala:87)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:73)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.
at org.apache.phoenix.exception.SQLExceptionCode$13.newException(SQLExceptionCode.java:312)
at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
at org.apache.phoenix.util.ServerUtil.parseRemoteException(ServerUtil.java:131)
at org.apache.phoenix.util.ServerUtil.parseServerExceptionOrNull(ServerUtil.java:115)
at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:104)
at org.apache.phoenix.iterate.TableResultIterator.getDelegate(TableResultIterator.java:70)
at org.apache.phoenix.iterate.TableResultIterator.<init>(TableResultIterator.java:88)
at org.apache.phoenix.iterate.TableResultIterator.<init>(TableResultIterator.java:79)
at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(PhoenixRecordReader.java:123)
... 28 more
2018-06-15 17:14:18,183 ERROR - Task 11 in stage 116.0 failed 4 times; aborting job
2018-06-15 17:14:18,184 INFO - Cancelling stage 116
2018-06-15 17:14:18,185 INFO - Stage 116 was cancelled
2018-06-15 17:14:18,186 INFO - ShuffleMapStage 116 (toJavaRDD at FeatureCompare.java:66) failed in 193.836 s
2018-06-15 17:14:18,186 INFO - Job 64 failed: takeOrdered at FeatureCompare.java:118, took 193.855857 s
2018-06-15 17:14:18,187 ERROR - Job aborted due to stage failure: Task 11 in stage 116.0 failed 4 times, most recent failure: Lost task 11.3 in stage 116.0 (TID 6821, slave1): java.lang.RuntimeException: org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.
at com.google.common.base.Throwables.propagate(Throwables.java:160)
at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(PhoenixRecordReader.java:138)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.<init>(NewHadoopRDD.scala:158)
at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:129)
at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:64)
at org.apache.phoenix.spark.PhoenixRDD.compute(PhoenixRDD.scala:53)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.UnionRDD.compute(UnionRDD.scala:87)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:73)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.
at org.apache.phoenix.exception.SQLExceptionCode$13.newException(SQLExceptionCode.java:312)
at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
at org.apache.phoenix.util.ServerUtil.parseRemoteException(ServerUtil.java:131)
at org.apache.phoenix.util.ServerUtil.parseServerExceptionOrNull(ServerUtil.java:115)
at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:104)
at org.apache.phoenix.iterate.TableResultIterator.getDelegate(TableResultIterator.java:70)
at org.apache.phoenix.iterate.TableResultIterator.<init>(TableResultIterator.java:88)
at org.apache.phoenix.iterate.TableResultIterator.<init>(TableResultIterator.java:79)
at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(PhoenixRecordReader.java:123)
... 28 more
Driver stacktrace:
org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1431)
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1419)
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1418)
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1418)
org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)
org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)
scala.Option.foreach(Option.scala:236)
org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:799)
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1640)
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1599)
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1588)
org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)
org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)
org.apache.spark.SparkContext.runJob(SparkContext.scala:1952)
org.apache.spark.rdd.RDD$$anonfun$reduce$1.apply(RDD.scala:1025)
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:111)
org.apache.spark.rdd.RDD.withScope(RDD.scala:316)
org.apache.spark.rdd.RDD.reduce(RDD.scala:1007)
org.apache.spark.rdd.RDD$$anonfun$takeOrdered$1.apply(RDD.scala:1397)
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:111)
org.apache.spark.rdd.RDD.withScope(RDD.scala:316)
org.apache.spark.rdd.RDD.takeOrdered(RDD.scala:1384)
org.apache.spark.api.java.JavaRDDLike$class.takeOrdered(JavaRDDLike.scala:592)
org.apache.spark.api.java.AbstractJavaRDDLike.takeOrdered(JavaRDDLike.scala:46)
com.gosun.spark.jobs.FeatureCompare.run(FeatureCompare.java:118)
com.gosun.spark.SparkBusi.dealWithData(SparkBusi.java:29)
com.syzg.inInterface.agentImpl.ReqDispatcher.run(ReqDispatcher.java:24)
java.lang.Thread.run(Thread.java:745)
2018-06-15 17:14:18,189 INFO - Lost task 10.3 in stage 116.0 (TID 6816) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 1]
2018-06-15 17:14:18,207 INFO - Lost task 8.3 in stage 116.0 (TID 6818) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 2]
2018-06-15 17:14:18,220 INFO - Lost task 12.3 in stage 116.0 (TID 6820) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 3]
2018-06-15 17:14:18,232 INFO - Lost task 27.3 in stage 116.0 (TID 6822) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 4]
2018-06-15 17:14:18,241 INFO - Lost task 3.3 in stage 116.0 (TID 6825) on executor master2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 5]
2018-06-15 17:14:18,261 INFO - Lost task 25.3 in stage 116.0 (TID 6823) on executor slave1: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 6]
2018-06-15 17:14:18,311 INFO - Lost task 24.3 in stage 116.0 (TID 6819) on executor slave5: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 7]
2018-06-15 17:14:18,311 INFO - Lost task 9.3 in stage 116.0 (TID 6817) on executor slave3: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 8]
2018-06-15 17:14:18,338 INFO - Lost task 13.3 in stage 116.0 (TID 6826) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 9]
2018-06-15 17:14:18,397 INFO - Lost task 20.3 in stage 116.0 (TID 6824) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 10]
2018-06-15 17:14:18,430 INFO - Lost task 0.3 in stage 116.0 (TID 6837) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 11]
2018-06-15 17:14:18,448 INFO - Lost task 19.3 in stage 116.0 (TID 6843) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 12]
2018-06-15 17:14:18,452 INFO - Lost task 26.3 in stage 116.0 (TID 6840) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 13]
2018-06-15 17:14:18,456 INFO - Lost task 23.3 in stage 116.0 (TID 6831) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 14]
2018-06-15 17:14:18,482 INFO - Lost task 1.3 in stage 116.0 (TID 6833) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 15]
2018-06-15 17:14:18,485 INFO - Lost task 22.3 in stage 116.0 (TID 6838) on executor slave1: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 16]
2018-06-15 17:14:18,492 INFO - Lost task 7.3 in stage 116.0 (TID 6834) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 17]
2018-06-15 17:14:18,497 INFO - Lost task 17.3 in stage 116.0 (TID 6829) on executor slave1: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 18]
2018-06-15 17:14:18,500 INFO - Lost task 2.3 in stage 116.0 (TID 6827) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 19]
2018-06-15 17:14:18,505 INFO - Lost task 21.3 in stage 116.0 (TID 6845) on executor slave3: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 20]
2018-06-15 17:14:18,513 INFO - Lost task 28.3 in stage 116.0 (TID 6839) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 21]
2018-06-15 17:14:18,536 INFO - Lost task 16.3 in stage 116.0 (TID 6836) on executor slave5: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 22]
2018-06-15 17:14:18,568 INFO - Lost task 4.3 in stage 116.0 (TID 6828) on executor slave5: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 23]
2018-06-15 17:14:18,627 INFO - Lost task 15.3 in stage 116.0 (TID 6832) on executor slave3: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 24]
2018-06-15 17:14:18,627 INFO - Lost task 14.3 in stage 116.0 (TID 6830) on executor slave2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 25]
2018-06-15 17:14:18,627 INFO - Lost task 29.3 in stage 116.0 (TID 6842) on executor slave4: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 26]
2018-06-15 17:14:18,628 INFO - Lost task 6.3 in stage 116.0 (TID 6841) on executor slave3: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 27]
2018-06-15 17:14:18,645 INFO - Lost task 18.3 in stage 116.0 (TID 6835) on executor master2: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 28]
2018-06-15 17:14:18,694 INFO - Lost task 5.3 in stage 116.0 (TID 6844) on executor slave6: java.lang.RuntimeException (org.apache.phoenix.schema.StaleRegionBoundaryCacheException: ERROR 1108 (XCL08): Cache of region boundaries are out of date.) [duplicate 29]
2018-06-15 17:14:18,694 INFO - Removed TaskSet 116.0, whose tasks have all completed, from pool
发现是phoenix的bug。
具体参考：
https://issues.apache.org/jira/browse/PHOENIX-2599