在文档中似乎应该足以设置/ etc / defaults / dse来启用上述所有功能。意思是,还增加了SPARK的支持。此外,节点工具现在指示所有内容都已启动并运行,并且(单节点)群集的类型为Graph,Search,Analytics因此启用工作正常,但尝试使用分析会导致配置级别的异常,这可能是与火花配置有关。但那里没有任何记录。似乎其他人也坚持这个问题。
这是完整的例外:构造Graph / TraversalSource时遇到错误 - com.google.inject.ProvisionException:无法配置,请参阅以下错误:1)注入构造函数时出错,com.datastax.bdp.gcore.datastore.DataStoreException:Failed在com.datastax.bdp.graph.impl.DseGraphImpl。(DseGraphImpl.java:189)的com.datastax.bdp.graph.impl.GraphModule.configure(未知来源)执行statementb5807f0d-b1b0-4bc3-bd77-794d21725fbb(通过模块:com.datastax.bdp.graph.impl.DseGraphFactoryImpl $$ Lambda $ 1430/208354649 - > com.google.inject.util.Modules $ OverrideModule - > com.datastax.bdp.graph.impl.GraphModule)在定位com时.datastax.bdp.graph.impl.DseGraphImpl 1 error构造Graph / TraversalSource时遇到错误 - 当Spark未运行或无法检测到时,无法创建OLAP遍历源。
请注意,尝试使用studio或gremlin控制台中的graph-analytics查询时会收到此异常。 cassandra日志文件等没有特定的错误。此外,从dse服务的角度来看,一切似乎都是正确的,但事实上它实际上并不起作用。
这些是在播放一些常量后出现的错误:
WARN [SPARK-MASTER] 2018-07-08 18:25:36,640 SPARK-MASTER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-MASTER] 2018-07-08 18:25:36,643 SPARK-MASTER Logging.scala:91 - Failed to bind MasterRedirectingUI
ERROR [SPARK-MASTER] 2018-07-08 18:25:36,643 SPARK-MASTER Logging.scala:72 - Failed to stop redirecting UI
WARN [SPARK-WORKER] 2018-07-08 18:25:36,671 SPARK-WORKER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-WORKER] 2018-07-08 18:25:36,672 SPARK-WORKER InternalServiceRunner.java:45 - SPARK-WORKER caused an exception in state STARTING:
ERROR [SPARK-MASTER] 2018-07-08 18:25:41,644 SPARK-MASTER InternalServiceRunner.java:45 - SPARK-MASTER caused an exception in state NOT_STARTED:
WARN [SPARK-MASTER] 2018-07-08 18:25:41,645 SPARK-MASTER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-MASTER] 2018-07-08 18:25:41,647 SPARK-MASTER Logging.scala:91 - Failed to bind MasterRedirectingUI
ERROR [SPARK-MASTER] 2018-07-08 18:25:41,647 SPARK-MASTER Logging.scala:72 - Failed to stop redirecting UI
ERROR [SPARK-MASTER] 2018-07-08 18:25:46,648 SPARK-MASTER InternalServiceRunner.java:45 - SPARK-MASTER caused an exception in state NOT_STARTED:
WARN [SPARK-MASTER] 2018-07-08 18:25:46,649 SPARK-MASTER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-MASTER] 2018-07-08 18:25:46,652 SPARK-MASTER Logging.scala:91 - Failed to bind MasterRedirectingUI
ERROR [SPARK-MASTER] 2018-07-08 18:25:46,652 SPARK-MASTER Logging.scala:72 - Failed to stop redirecting UI
WARN [SPARK-WORKER] 2018-07-08 18:25:46,673 SPARK-WORKER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-WORKER] 2018-07-08 18:25:46,673 SPARK-WORKER InternalServiceRunner.java:45 - SPARK-WORKER caused an exception in state STARTING:
ERROR [SPARK-MASTER] 2018-07-08 18:25:51,653 SPARK-MASTER InternalServiceRunner.java:45 - SPARK-MASTER caused an exception in state NOT_STARTED:
WARN [SPARK-MASTER] 2018-07-08 18:25:51,653 SPARK-MASTER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-MASTER] 2018-07-08 18:25:51,656 SPARK-MASTER Logging.scala:91 - Failed to bind MasterRedirectingUI
ERROR [SPARK-MASTER] 2018-07-08 18:25:51,656 SPARK-MASTER Logging.scala:72 - Failed to stop redirecting UI
ERROR [SPARK-MASTER] 2018-07-08 18:25:56,657 SPARK-MASTER InternalServiceRunner.java:45 - SPARK-MASTER caused an exception in state NOT_STARTED:
WARN [SPARK-MASTER] 2018-07-08 18:25:56,658 SPARK-MASTER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-MASTER] 2018-07-08 18:25:56,660 SPARK-MASTER Logging.scala:91 - Failed to bind MasterRedirectingUI
ERROR [SPARK-MASTER] 2018-07-08 18:25:56,660 SPARK-MASTER Logging.scala:72 - Failed to stop redirecting UI
WARN [SPARK-WORKER] 2018-07-08 18:25:56,673 SPARK-WORKER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-WORKER] 2018-07-08 18:25:56,674 SPARK-WORKER InternalServiceRunner.java:45 - SPARK-WORKER caused an exception in state STARTING:
ERROR [SPARK-MASTER] 2018-07-08 18:26:01,661 SPARK-MASTER InternalServiceRunner.java:45 - SPARK-MASTER caused an exception in state NOT_STARTED:
WARN [SPARK-MASTER] 2018-07-08 18:26:01,662 SPARK-MASTER Logging.scala:47 - Not overriding system property java.library.path
ERROR [SPARK-MASTER] 2018-07-08 18:26:01,665 SPARK-MASTER Logging.scala:91 - Failed to bind MasterRedirectingUI
ERROR [SPARK-MASTER] 2018-07-08 18:26:01,665 SPARK-MASTER Logging.scala:72 - Failed to stop redirecting UI
ERROR [SPARK-MASTER] 2018-07-08 18:26:06,665 SPARK-MASTER InternalServiceRunner.java:45 - SPARK-MASTER caused an exception in state NOT_STARTED:
好吧,有了这个日志,它变得越来越清晰。真正的罪魁祸首是这个消息:Failed to bind MasterRedirectingUI
- 这意味着Spark Master无法启动,因为有人已经在侦听它正试图使用的端口 - 默认情况下它是7080
,但它可以通过在SPARK_MASTER_WEBUI_PORT
文件中设置spark-env.sh
变量来覆盖(无论是在tarball安装中的resources/spark/conf
,还是在/etc/dse/spark/
中)。
检查没有其他进程正在侦听这些端口 - 您可以使用netstat -plnt
执行此操作...