The mod not lagging in dense areas

[Nikev2]

I have a village with 120 villagers and my spawnpoint is there as well the problem is that they keep lagging like crazy does this have to due with the always renderd chunks or a mod conflict. I tried in another world and the villagers didn't lag at all

[maximogta]

Same issue here with forge 1.20.1, tps go to 70 in villagers, outside of them i get 20 tps.

[Eriuis]

Same issue