@explodingcamera/next-plugin-styled-components made it possible to use styled-components in next.js without any special configuration, HMR included.
Due to the removal of propper plugin support, this isn't possible with next.js anymore. Please check out their example for how to manually configure styled-components support here.