JanusGraph with SparkComputer 抛出异常:GetNewApplicationRequestProto cannot be cast to com.google.protobuf.Message
JanusGraph with SparkComputer throws an exception: GetNewApplicationRequestProto cannot be cast to com.google.protobuf.Message
当我使用 JanusGraph2.0 并将 yarn 上的火花传输到计算机时,例如:
gremlin> graph = GraphFactory.open('conf/hadoop-graph/hadoop-load.properties')
==>hadoopgraph[gryoinputformat->nulloutputformat]
gremlin> blvp = BulkLoaderVertexProgram.build().writeGraph('conf/janusgraph-cassandra.properties').create(graph)
==>BulkLoaderVertexProgram[bulkLoader=IncrementalBulkLoader,vertexIdProperty=bulkLoader.vertex.id,userSuppliedIds=false,keepOriginalIds=true,batchSize=0]
gremlin> graph.compute(SparkGraphComputer).program(blvp).submit().get()
它抛出一个异常:
08:57:03 ERROR org.apache.spark.SparkContext - Error initializing SparkContext.
java.lang.ClassCastException: org.apache.hadoop.yarn.proto.YarnServiceProtos$GetNewApplicationRequestProto cannot be cast to com.google.protobuf.Message
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:226)
at com.sun.proxy.$Proxy23.getNewApplication(Unknown Source)
谁能帮我解决这个问题?谢谢
这个问题是 cross-posted 在 janusgraph-users 那里回答的。
Check the version compatibility matrix. JanusGraph 0.2.0 is not compatible with Spark 2.11. http://docs.janusgraph.org/latest/version-compat.html
JanusGraph 0.2.0 是 compiled/tested 与 Spark 1.6.1。确保对齐版本。
当我使用 JanusGraph2.0 并将 yarn 上的火花传输到计算机时,例如:
gremlin> graph = GraphFactory.open('conf/hadoop-graph/hadoop-load.properties')
==>hadoopgraph[gryoinputformat->nulloutputformat]
gremlin> blvp = BulkLoaderVertexProgram.build().writeGraph('conf/janusgraph-cassandra.properties').create(graph)
==>BulkLoaderVertexProgram[bulkLoader=IncrementalBulkLoader,vertexIdProperty=bulkLoader.vertex.id,userSuppliedIds=false,keepOriginalIds=true,batchSize=0]
gremlin> graph.compute(SparkGraphComputer).program(blvp).submit().get()
它抛出一个异常:
08:57:03 ERROR org.apache.spark.SparkContext - Error initializing SparkContext.
java.lang.ClassCastException: org.apache.hadoop.yarn.proto.YarnServiceProtos$GetNewApplicationRequestProto cannot be cast to com.google.protobuf.Message
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:226)
at com.sun.proxy.$Proxy23.getNewApplication(Unknown Source)
谁能帮我解决这个问题?谢谢
这个问题是 cross-posted 在 janusgraph-users 那里回答的。
Check the version compatibility matrix. JanusGraph 0.2.0 is not compatible with Spark 2.11. http://docs.janusgraph.org/latest/version-compat.html
JanusGraph 0.2.0 是 compiled/tested 与 Spark 1.6.1。确保对齐版本。