The basics are already there. It may be a bad reference (the SHA given is for a merge commit) or we may need a GitHub App to do this. In that case I feel it should be raising errors rather than failing silently, but who knows.
It might not be possible at all, but it would be nice.