Authenticated in Realm but Application wont log me in

[nsauter]

First of all: I'm not sure if this is an issue or intended, but help would be appreciated. Thanks in advance.

I installed the plugin and managed to get it working with my Keycloak instance. So if I browse to app.example.com, I get redirected to the Keycloak login page. After that, I get redirected back to the web service I was trying to access, but without the automatic SSO login function. In my case, it's "Outline", which uses the exact same Keycloak realm as an identity source. If i then click on "Login" in "Outline im not prompted for a password and username. Instead of this i get logged in directly.

Am I missing something? I would expect that my Keycloak cookie gets checked, and then there should be no need to click "log in" again with the same IdP?