test: track and fix flaky CI tests

[mikesmithgh]

Failures

kitty_scrollback_config_demo_04_spec.lua

04/07/2024

plenary (stable, 0.32.2)
kitty_scrollback_config_demo_04_spec.lua
https://github.com/mikesmithgh/kitty-scrollback.nvim/actions/runs/8585749456/job/23527481200#logs
Actual:

            N▏ mple > --config ksb_example_paste_win_register_disabled    

Expected:

            N▏# example > --config ksb_example_paste_win_register_disabled    

Most likely steps are too fast for CI and insert starts at the a character in example

(x2) kitty-scrollback.nvim should open scrollback buffer over ssh

04/11/2024

plenary (nightly, nightly)
kitty_scrollback_linux_ci_spec.lua
https://github.com/mikesmithgh/kitty-scrollback.nvim/actions/runs/8639464191/job/23685817654

'$ rm -f ~/.ssh/id_ed25519_ci_test && ssh-keygen -t ed25519 -f ~/.ssh/id_ed25519_ci_test -N ''        󰄛 󰣐 
            Generating public/private ed25519 key pair.
            Created directory '/home/runner/.ssh'.
            Your identification has been saved in /home/runner/.ssh/id_ed25519_ci_test
            Your public key has been saved in /home/runner/.ssh/id_ed25519_ci_test.pub
            The key fingerprint is:
            SHA256:FH24knMqBamheiTc3CCff2FEc1uNPAMyHhbD44Nl+/A runner@fv-az1490-898
            The key's randomart image is:
            +--[ED25519 256]--+
            |      o@o+ooo    |
            | . .. =*B.==..   |
            |. =.+o*o+o oo    |
            |..o=.o O= o      |
            | +  . ..S=       |
            |. .  ....E       |
            | .    ..         |
            |                 |
            |                 |
            +----[SHA256]-----+
            $ cat ~/.ssh/id_ed25519_ci_test.pub >> ~/.ssh/authorized_keys
            $ ssh -o "StrictHostKeyChecking no" -i ~/.ssh/id_ed25519_ci_test localhost
            TERM=xterm
            clear; \
            [ Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
            -
            '
            Expected:
            (string) 'You are connected via SSH.                                                                           󰄛 󰣐 
            '

kitty-scrollback.nvim kitty_scrollback_nvim

04/12/2024
plenary (stable, nightly)
kitty_scrollback_demo_spec.lua

https://github.com/mikesmithgh/kitty-scrollback.nvim/actions/runs/8659643240/job/23745967551#step:11:307

    Passed in:
            (string) '$ git status
            On branch main
            Your branch is up to date with 'origin/main'.
            Changes not staged for commit:
              (use "git add <file>..." to update what will be committed)
              (use "git restore <file>..." to discard changes in working directory)
            	modified:   README.md
            	modified:   lua/kitty-scrollback/api.lua
            	modified:   lua/kitty-scrollback/health.lua
            	modified:   lua/kitty-scrollback/init.lua
            no changes added to commit (use "git add" and/or "git commit -a")
            $ DME.md
            git add jjj$yddggIgit checkout
...omitted
            Expected:
            (string) '$ git status
            On branch main
            Your branch is up to date with 'origin/main'.
            Changes not staged for commit:
              (use "git add <file>..." to update what will be committed)
              (use "git restore <file>..." to discard changes in working directory)
            	modified:   README.md
            	modified:   lua/kitty-scrollback/api.lua
            	modified:   lua/kitty-scrollback/health.lua
            	modified:   lua/kitty-scrollback/init.lua
            no changes added to commit (use "git add" and/or "git commit -a")
            $ git checkout README.md

[mikesmithgh]

#235 reduced test matrix from 19 to 13, hopefully this improves reliability

[mikesmithgh]

Have not had flaky tests since reducing the combinations in the test matrix. Closing as I plan to further reduce the number of versions. Reopen if issues start again.