我正在尝试将 ignite 2.4 与 Spark 2.1 一起使用。 我从 ignite 的二进制文件中添加了以下库的路径
spark-shell
--conf spark.diver.extraClassPath=/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/*:/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/optional/*:/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/ignite-indexing/*:/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/ignite-spring/* --conf spark.executor.extraClassPath=/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/*:/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/optional/*:/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/ignite-indexing/*:/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/ignite-spring/*
但是,我无法导入任何库,例如
import org.apache.ignite.configuration._
error: object ignite is not a member of package org.apache
我该如何解决这个问题?
/home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/optional/*:
- Ignite 在 optional
中包含许多子文件夹,但 java 不将子文件夹包含到类路径中。要包含 Spark jar,您应该将 /home/sshuser/apache-ignite-fabric-2.4.0-bin/libs/optional/ignite-spark/*
添加到类路径中。请阅读官方文档 - https://apacheignite-fs.readme.io/v2.4/docs/installation-deployment