davidfoerster/KaleidOK-examples

Audio processing thread freezing and going idle

Closed this issue · 4 comments

kaleidOk is freezeng a lot and going Idle very often. This is new behaviour and I think unrelated to my graphics card

See the video:
https://drive.google.com/file/d/0BwbcYwZE23T1SHg1MVR0SFZkY1E/view?usp=sharing

You're running it with JDK 1.8, but neither Processing v3.0a5 nor TarsosDSP v2.1 support it (yet). Please try again with JDK 1.7 until KaleidOK is migrated to a newer version of Processing, that supports JDK 1.8 (exclusively).

If you submit a new video, it would be good to have a description, of what you're doing at each moment, if it's not obvious visually – either through an audio commentary (should work at the same time as the audio stuff from KaleidOK) or timed "subtitles".

I also noticed, that the sampling format might be different than expected in your setup. There exceptions in the program output pointing towards this and some of the freezes seem to occur at the same time as the exceptions. I'll investigate this issue further, if it reappears with JDK 1.7.

According to our conversation, installing and switching to JDK 1.7 as the project SDK in IntelliJ fixed the exception visible in the video (AssertionError at com.getflourish.stt2.AudioTranscriptionProcessor.convertTo16Bit(AudioTranscriptionProcessor.java:195)).

Reopening since the issue reappeared. Error log from @Disastergirl via Skype:

/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/bin/java -Djava.library.path=/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-i586.jar -ea -Didea.launcher.port=7533 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA 14 CE.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/javafx-doclet.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/lib/tools.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/htmlconverter.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Volumes/Disasterchine/Applications2/GitHub/KaleidOK-examples/out/production/Kaleidoscope:/Volumes/Disasterchine/Processing/projects/libraries/TarsosDSP-2.2/library/TarsosDSP-2.2-bin.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-macosx-universal.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt-natives-windows-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/gluegen-rt.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-armv6hf.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-linux-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-macosx-universal.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-amd64.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all-natives-windows-i586.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/jogl-all.jar:/Volumes/Applications/Applications/Processing.app/Contents/Java/core/library/core.jar:/Volumes/Disasterchine/Applications2/GitHub/KaleidOK-examples/out/production/libraries:/Volumes/Disasterchine/Tran2cre8/Audio Applications/minim/minim.jar:/Users/kimberleybianca/.m2/repository/com/google/code/gson/gson/2.3.1/gson-2.3.1.jar:/Volumes/Disasterchine/Applications2/GitHub/KaleidOK-examples/out/production/javaFlacEncoder:/Volumes/Disasterchine/Applications2/GitHub/synesketch/bin:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/fluent-hc/4.5/fluent-hc-4.5.jar:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/httpclient/4.5/httpclient-4.5.jar:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/httpcore/4.4.1/httpcore-4.4.1.jar:/Users/kimberleybianca/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/kimberleybianca/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/kimberleybianca/.m2/repository/com/jakewharton/disklrucache/2.0.2/disklrucache-2.0.2.jar:/Users/kimberleybianca/.m2/repository/org/apache/httpcomponents/httpclient-cache/4.5/httpclient-cache-4.5.jar:/Users/kimberleybianca/.m2/repository/org/apache/commons/commons-collections4/4.0/commons-collections4-4.0.jar:/Applications/IntelliJ IDEA 14 CE.app/Contents/lib/idea_rt.jar" com.intellij.rt.execution.application.AppMain kaleidok.examples.kaleidoscope.KaleidoscopeApp
RECORDING
Exception in thread "Audio dispatching" java.lang.AssertionError
  at com.getflourish.stt2.AudioTranscriptionProcessor.convertTo16Bit(AudioTranscriptionProcessor.java:195)
  at com.getflourish.stt2.AudioTranscriptionProcessor.process(AudioTranscriptionProcessor.java:41)
  at be.tarsos.dsp.AudioDispatcher.run(AudioDispatcher.java:269)
  at kaleidok.examples.kaleidoscope.Kaleidoscope$1.run(Kaleidoscope.java:329)
  at java.lang.Thread.run(Thread.java:745)

This appears to be platform-specific, so I need to debug this on your machine. Screensharing through TeamViewer or similar would be the easiest route for that.