$ SPARK_HADOOP_VERSION=2.2.0 SPARK_YARN=true sbt/sbt clean assembly
It’s important to use “clean assembly” instead of simply “assembly” as sbt doesn’t clean some artifacts that are built for the default hadoop version 1.0.4
$ SPARK_HADOOP_VERSION=2.2.0 SPARK_YARN=true sbt/sbt clean assembly
It’s important to use “clean assembly” instead of simply “assembly” as sbt doesn’t clean some artifacts that are built for the default hadoop version 1.0.4