当我在 Ubuntu 14.04 中 运行 make-distribution.sh 时，Spark 1.3.1 在 MLlib 中安装失败
Spark 1.3.1 install failed in MLlib when I run make-distribution.sh in Ubuntu 14.04
当我在 Ubuntu 14.04
中 运行 make-distribution.sh 时，Spark 1.3.1 在 MLlib 中安装失败
- Java-版本：
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
- Scala -版本：
Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
- 失败消息：
`
INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project ML Library 1.3.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for net.sf.opencsv:opencsv:jar:2.3 is invalid, transitive dependencies (if any) will not be available, enable debug logging for more detail
s
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-mllib_2.10 ---
[INFO] Deleting /home/tongz/project/spark/spark/mllib/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:add-source (eclipse-add-source) @ spark-mllib_2.10 ---
[INFO] Add Source directory: /home/tongz/project/spark/spark/mllib/src/main/scala
[INFO] Add Test Source directory: /home/tongz/project/spark/spark/mllib/src/test/scala
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-mllib_2.10 ---
[INFO] Source directory: /home/tongz/project/spark/spark/mllib/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-mllib_2.10 ---
[WARNING] Invalid POM for net.sf.opencsv:opencsv:jar:2.3, transitive dependencies (if any) will not be available, enable debug logging for more details
[WARNING] Invalid project model for artifact [opencsv:net.sf.opencsv:2.3]. It will be ignored by the remote resources Mojo.
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-mllib_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 26 resources
[INFO] Copying 3 resources
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-mllib_2.10 ---
[INFO] Using zinc server for incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[info] Compiling 144 Scala sources and 2 Java sources to /home/tongz/project/spark/spark/mllib/target/scala-2.10/classes...
[error] error while loading , error in opening zip file
[error] object scala.runtime in compiler mirror not found.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [4.145s]
[INFO] Spark Project Networking .......................... SUCCESS [11.811s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.064s]
[INFO] Spark Project Core ................................ SUCCESS [2:39.458s]
[INFO] Spark Project Bagel ............................... SUCCESS [5.837s]
[INFO] Spark Project GraphX .............................. SUCCESS [17.580s]
[INFO] Spark Project Streaming ........................... SUCCESS [30.898s]
[INFO] Spark Project Catalyst ............................ SUCCESS [34.868s]
[INFO] Spark Project SQL ................................. SUCCESS [41.695s]
[INFO] Spark Project ML Library .......................... FAILURE [0.522s]
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project External Kafka Assembly ............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:13.600s
[INFO] Finished at: Sun May 03 21:23:26 EDT 2015
[INFO] Final Memory: 41M/499M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.0:compile (scala-compile-first) on project spark-mllib_2.10: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.0:compile failed. CompileFailed -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :spark-mllib_2.10
`
这是最后几行错误信息，如果你需要我可以提供更多。
提前致谢！
好的，等了12个小时还是没有回音！我挖掘了很多 我想我自己找到了答案
这是诀窍：
<code>
sbt clean clean-files
rm -rf ~/.ivy2 ~/.m2 ~/.sbt
</p>
<p>这两行是问题所在
[错误] 加载时出错，打开 zip 文件时出错
[错误] 编译器镜像中的对象 scala.runtime 未找到。
据我所知，我之前破坏了一些标量或 mvn 包，它导致了这个错误，我必须删除它们。也可能是因为 sbt 太旧了，这就是我清理它的原因。
PS：如果你想找到损坏的包，请遵循 cli
找到 ~/.ivy2 ~/.m2 ~/.sbt -name "*.jar" -exec unzip -qqt {} \;
当我在 Ubuntu 14.04
中 运行 make-distribution.sh 时，Spark 1.3.1 在 MLlib 中安装失败- Java-版本：
java version "1.7.0_80" Java(TM) SE Runtime Environment (build 1.7.0_80-b15) Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode) - Scala -版本：
Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL - 失败消息：
`
INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project ML Library 1.3.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for net.sf.opencsv:opencsv:jar:2.3 is invalid, transitive dependencies (if any) will not be available, enable debug logging for more detail
s
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-mllib_2.10 ---
[INFO] Deleting /home/tongz/project/spark/spark/mllib/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:add-source (eclipse-add-source) @ spark-mllib_2.10 ---
[INFO] Add Source directory: /home/tongz/project/spark/spark/mllib/src/main/scala
[INFO] Add Test Source directory: /home/tongz/project/spark/spark/mllib/src/test/scala
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-mllib_2.10 ---
[INFO] Source directory: /home/tongz/project/spark/spark/mllib/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-mllib_2.10 ---
[WARNING] Invalid POM for net.sf.opencsv:opencsv:jar:2.3, transitive dependencies (if any) will not be available, enable debug logging for more details
[WARNING] Invalid project model for artifact [opencsv:net.sf.opencsv:2.3]. It will be ignored by the remote resources Mojo.
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-mllib_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 26 resources
[INFO] Copying 3 resources
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-mllib_2.10 ---
[INFO] Using zinc server for incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[info] Compiling 144 Scala sources and 2 Java sources to /home/tongz/project/spark/spark/mllib/target/scala-2.10/classes...
[error] error while loading , error in opening zip file
[error] object scala.runtime in compiler mirror not found.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [4.145s]
[INFO] Spark Project Networking .......................... SUCCESS [11.811s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.064s]
[INFO] Spark Project Core ................................ SUCCESS [2:39.458s]
[INFO] Spark Project Bagel ............................... SUCCESS [5.837s]
[INFO] Spark Project GraphX .............................. SUCCESS [17.580s]
[INFO] Spark Project Streaming ........................... SUCCESS [30.898s]
[INFO] Spark Project Catalyst ............................ SUCCESS [34.868s]
[INFO] Spark Project SQL ................................. SUCCESS [41.695s]
[INFO] Spark Project ML Library .......................... FAILURE [0.522s]
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project External Kafka Assembly ............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:13.600s
[INFO] Finished at: Sun May 03 21:23:26 EDT 2015
[INFO] Final Memory: 41M/499M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.0:compile (scala-compile-first) on project spark-mllib_2.10: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.0:compile failed. CompileFailed -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :spark-mllib_2.10
`
这是最后几行错误信息，如果你需要我可以提供更多。
提前致谢！
好的，等了12个小时还是没有回音！我挖掘了很多 我想我自己找到了答案
这是诀窍：
<code>
sbt clean clean-files
rm -rf ~/.ivy2 ~/.m2 ~/.sbt
</p>
<p>这两行是问题所在
[错误] 加载时出错，打开 zip 文件时出错
[错误] 编译器镜像中的对象 scala.runtime 未找到。
据我所知，我之前破坏了一些标量或 mvn 包，它导致了这个错误，我必须删除它们。也可能是因为 sbt 太旧了，这就是我清理它的原因。
PS：如果你想找到损坏的包，请遵循 cli 找到 ~/.ivy2 ~/.m2 ~/.sbt -name "*.jar" -exec unzip -qqt {} \;