SmbIO doesn't work when SortedBucketTransforms have SideInputs
clairemcginty opened this issue · 0 comments
clairemcginty commented
Reproduction: https://github.com/spotify/scio/compare/smb-io-side-input?expand=1
Produces the error:
Caused by: java.lang.IllegalArgumentException: calling sideInput() with unknown view
at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner.sideInput(SimpleDoFnRunner.java:244)
at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner.access$1200(SimpleDoFnRunner.java:85)
at org.apache.beam.repackaged.direct_java.runners.core.SimpleDoFnRunner$DoFnProcessContext.sideInput(SimpleDoFnRunner.java:400)
at com.spotify.scio.values.SingletonSideInput.get(SideInput.scala:104)
at com.spotify.scio.values.SideInput.getCache(SideInput.scala:47)
at com.spotify.scio.values.SideInput.getCache$(SideInput.scala:41)
at com.spotify.scio.values.SingletonSideInput.getCache(SideInput.scala:102)
at com.spotify.scio.values.SideInputContext.apply(SideInput.scala:150)
at com.spotify.scio.smb.SmbTransformWithSideInputsJob$$anonfun$main$3.apply(SmbIOTest.scala:135)
at com.spotify.scio.smb.SmbTransformWithSideInputsJob$$anonfun$main$3.apply(SmbIOTest.scala:133)
at com.spotify.scio.smb.SortMergeTransform$ViaTransformWithSideOutput.processElement(SortMergeTransform.scala:243)