DeNA/Anjin

Failing test run on batchmode

Closed this issue · 3 comments

Failing test below:

<test-case id="1048" name="WithScreenshot" fullname="DeNA.Anjin.Reporters.SlackMessageSenderTest.WithScreenshot" methodname="WithScreenshot" classname="DeNA.Anjin.Reporters.SlackMessageSenderTest" runstate="Runnable" seed="670020325" result="Failed" start-time="2023-11-17 11:07:51Z" end-time="2023-11-17 11:07:51Z" duration="0.029152" asserts="0">
  <properties>
    <property name="platform" value="PlayMode" />
  </properties>
  <failure>
    <message><![CDATA[  Expected is <System.Collections.Generic.List`1[System.Collections.Generic.Dictionary`2[System.String,System.String]]]]><![CDATA[> with 3 elements, actual is <System.Collections.Generic.List`1[System.Collections.Generic.Dictionary`2[System.String,System.String]]]]><![CDATA[> with 2 elements
Values differ at index [1]
Expected and actual are both <System.Collections.Generic.Dictionary`2[System.String,System.String]> with 4 elements
]]></message>
    <stack-trace><![CDATA[at DeNA.Anjin.Reporters.SlackMessageSenderTest+<WithScreenshot>d__2.MoveNext () [0x001d4] in /github/workspace/Packages/com.dena.anjin/Tests/Runtime/Reporters/SlackMessageSenderTest.cs:120
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <eae584ce26bc40229c1b1aa476bfa589>:0
at UnityEngine.TestTools.TestRunner.TestTaskWrapper+<Execute>d__2.MoveNext () [0x00074] in /github/workspace/Library/PackageCache/com.unity.test-framework@1.3.4/UnityEngine.TestRunner/TestRunner/TestTaskWrapper.cs:31
at UnityEngine.TestTools.TestEnumerator+<Execute>d__7.MoveNext () [0x0004e] in /github/workspace/Library/PackageCache/com.unity.test-framework@1.3.4/UnityEngine.TestRunner/NUnitExtensions/Attributes/TestEnumerator.cs:44
]]></stack-trace>
  </failure>
</test-case>

This test is calling take screenshots.
But taking a screenshot is not running on batch mode.
(Anjin is not supported running on batchmode.)

Hmm, strange... I tested it on only macOS, so I got missed it.

I don't have any Linux machines now, so I cannot reproduce it. I'm gonna try to get a Linux machine, but don't get your hopes up.

Misunderstanding: when running on Linux editor
Correctly: when running on batchmode (skip screenshot)