Does any paper construct the contrast pair between the shallow features and the deep features?

[joe1chief]

Does any paper construct the contrast pair between the shallow features and the deep features?

[phillipi]

Yep! DeepInfoMax is a notable example of doing that: https://arxiv.org/abs/1808.06670