spark streaming 打包将全部依赖打进去,运行jar包报错:如下
Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes
PS D:\workspace\ideaProject\java\wordcount\out\artifacts\wordcount_jar> spark-submit .\wordcount.jar localhost:9092 test 2019-08-23 15:37:18 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes at sun.security.util.SignatureFiLeverifier.processImpl(SignatureFiLeverifier.java:284) at sun.security.util.SignatureFiLeverifier.process(SignatureFiLeverifier.java:238) at java.util.jar.JarVerifier.processEntry(JarVerifier.java:316) at java.util.jar.JarVerifier.update(JarVerifier.java:228) at java.util.jar.JarFile.initializeVerifier(JarFile.java:383) at java.util.jar.JarFile.getInputStream(JarFile.java:450) at sun.misc.JarIndex.getJarIndex(JarIndex.java:137) at sun.misc.URLClasspath$JarLoader$1.run(URLClasspath.java:839) at sun.misc.URLClasspath$JarLoader$1.run(URLClasspath.java:831) at java.security.AccessController.doPrivileged(Native Method) at sun.misc.URLClasspath$JarLoader.ensureOpen(URLClasspath.java:830) at sun.misc.URLClasspath$JarLoader.<init>(URLClasspath.java:803) at sun.misc.URLClasspath$3.run(URLClasspath.java:530) at sun.misc.URLClasspath$3.run(URLClasspath.java:520) at java.security.AccessController.doPrivileged(Native Method) at sun.misc.URLClasspath.getLoader(URLClasspath.java:519) at sun.misc.URLClasspath.getLoader(URLClasspath.java:492) at sun.misc.URLClasspath.getNextLoader(URLClasspath.java:457) at sun.misc.URLClasspath.getResource(URLClasspath.java:211) at java.net.urlclassloader$1.run(urlclassloader.java:365) at java.net.urlclassloader$1.run(urlclassloader.java:362) at java.security.AccessController.doPrivileged(Native Method) at java.net.urlclassloader.findClass(urlclassloader.java:361) at java.lang.classLoader.loadClass(ClassLoader.java:424) at java.lang.classLoader.loadClass(ClassLoader.java:357) at java.lang.class.forName0(Native Method) at java.lang.class.forName(Class.java:348) at org.apache.spark.util.Utils$.classForName(Utils.scala:239) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:851) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:198) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:228) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:137) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
解决方式:只将有需要的包打进去,因为spark的lib下已经有很多jar包,不需要我们重复打进jar包,只需要把lib没有的jar包打进去运行就好。因为包的重复引用会导致生成多个MF文件
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 [email protected] 举报,一经查实,本站将立刻删除。