matthias-wright/flaxmodels

StyleGAN2 `--fmap_base` only affects generator feature maps

MasterScrat opened this issue · 1 comments

Hello Matthias,

We have noticed that adjusting the value of --fmap_base only affects the generator:

synthesis_net = fm.stylegan2.SynthesisNetwork(resolution=config.resolution,

but not the discriminator:

discriminator = fm.stylegan2.Discriminator(resolution=config.resolution,

Is this intentional?

In the StyleGAN 2 paper, both G and D receive increased capacity (bottom of page 7):

This leads us to hypothesize that there is a capacity problem in our networks, which we test by doubling the number of feature maps in the highest-resolution layers of both networks.

We double the number of feature maps in resolutions 64^2–1024^2 while keeping other parts of the networks unchanged. This increases the total number of trainable parameters in the generator by 22% (25M → 30M) and in the discriminator by 21% (24M → 29M).

Hi @MasterScrat, thanks for pointing that out, I fixed it.