Clean-up github actions setup

[kiran-kate]

The build.yml in .github/workflows needs to be reviewed and cleaned up. We noticed the following issues:

• The pip cache mechanism doesn't seem to work as expected i.e. it doesn't refresh if setup.py specifies a different version of a dependency.
• The usage of matrix and if statements for exceptions looks inconsistent.

[shinnar]

fixed