运行数据流时出现问题

问题描述 投票:1回答:1

我在运行数据流作业时遇到错误。我试图将我现有的光束版本更新为2.11.0,但我在运行时遇到错误。

java.lang.IncompatibleClassChangeError:类org.apache.beam.model.pipeline.v1.RunnerApi $ StandardPTransforms $ Primitives未在org.apache.beam.runners.core.construction中实现请求的com.google.protobuf.ProtocolMessageEnum接口。在org.apache.beam.runners.core.construction.PTransformTranslation(PTransformTranslation.java:58)的BeamUrns.getUrn(BeamUrns.java:27)org.apache.beam.runners.core.construction.UnconsumedReads $ 1.visitValue( UnconsumedReads.java:49)org.apache.beam.dun.TransformHierarchy $ Node.visit(TransformHierarchy.java:666)at org.apache.beam.sdk.runners.TransformHierarchy $ Node.visit(TransformHierarchy.java: 649)org.apache.beam.sdk.runners.TransformHierarchy $ Node.visit(TransformHierarchy.java:649)org.apache.beam.sdk.runners.TransformHierarchy $ Node.visit(TransformHierarchy.java:649)at org .apache.beam.sdk.runners.TransformHierarchy $ Node.access $ 600(TransformHierarchy.java:311)at org.apache.beam.sdk.runners.TransformHierarchy.visit(Transfor mgierarchy.java:245)org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)org.apache.beam.runners.core.construction.UnconsumedReads.ensureAllReadsConsumed(UnconsumedReads.java:40)at org位于org.apache.beam.runners.dataflow的org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:660)上的.apache.beam.runners.dataflow.DataflowRunner.replaceTransforms(DataflowRunner.java:868) .DataflowRunner.run(DataflowRunner.java:173)org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)

google-cloud-dataflow apache-beam
1个回答
1
投票

这通常意味着构建Beam的com.google.protobuf:protobuf-java版本与运行时版本不匹配。您的管道代码是否也依赖于协议缓冲区?

更新:我已经提交https://issues.apache.org/jira/browse/BEAM-6839来跟踪这个。这不是预期的。

© www.soinside.com 2019 - 2024. All rights reserved.