Mathux/TEMOS

when I just set 'vae=False' in temos.yaml,I got errors below

Closed this issue · 1 comments

hi authors, I want to try a situation when VAE is disabled and save its weights. but I was trapped in some problems(sorry, I just started)

  File "/Users/eanson/opt/miniconda3/envs/temos/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 370, in validation_step
    return self.model.validation_step(*args, **kwargs)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/base.py", line 33, in validation_step
    return self.allsplit_step("val", batch, batch_idx)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/temos.py", line 144, in allsplit_step
    loss = self.losses[split].update(ds_text=datastruct_from_text,
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/compute.py", line 83, in update
    total += self._update_loss("kl_text2motion", dis_text, dis_motion)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/compute.py", line 105, in _update_loss
    val = self._losses_func[loss](outputs, inputs)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/kl.py", line 9, in __call__
    div = torch.distributions.kl_divergence(q, p)
  File "/Users/eanson/opt/miniconda3/envs/temos/lib/python3.9/site-packages/torch/distributions/kl.py", line 170, in kl_divergence
    raise NotImplementedError("No KL(p || q) is implemented for p type {} and q type {}"
NotImplementedError: No KL(p || q) is implemented for p type NoneType and q type NoneType

pip list

Package                 Version
----------------------- -----------
absl-py                 1.3.0
aiohttp                 3.8.3
aiosignal               1.2.0
antlr4-python3-runtime  4.9.3
astroid                 2.12.12
async-timeout           4.0.2
attrs                   22.1.0
beautifulsoup4          4.11.1
cachetools              5.2.0
certifi                 2022.9.24
charset-normalizer      2.1.1
colorlog                6.7.0
commonmark              0.9.1
contourpy               1.0.6
cycler                  0.11.0
decorator               4.4.2
dill                    0.3.6
einops                  0.5.0
filelock                3.8.0
fonttools               4.38.0
frozenlist              1.3.1
fsspec                  2022.10.0
google-auth             2.13.0
google-auth-oauthlib    0.4.6
grpcio                  1.50.0
huggingface-hub         0.10.1
hydra-colorlog          1.2.0
hydra-core              1.2.0
idna                    3.4
imageio                 2.22.2
imageio-ffmpeg          0.4.7
importlib-metadata      5.0.0
isort                   5.10.1
kiwisolver              1.4.4
lazy-object-proxy       1.7.1
Markdown                3.4.1
MarkupSafe              2.1.1
matplotlib              3.6.1
mccabe                  0.7.0
moviepy                 1.0.3
multidict               6.0.2
numpy                   1.23.4
oauthlib                3.2.2
omegaconf               2.2.3
packaging               21.3
pandas                  1.5.1
Pillow                  9.3.0
pip                     22.2.2
platformdirs            2.5.2
proglog                 0.1.10
protobuf                3.19.6
psutil                  5.9.3
pyasn1                  0.4.8
pyasn1-modules          0.2.8
pyDeprecate             0.3.2
Pygments                2.13.0
pylint                  2.15.5
pyparsing               3.0.9
PySocks                 1.7.1
python-dateutil         2.8.2
pytorch-lightning       1.7.7
pytz                    2022.5
PyYAML                  6.0
regex                   2022.9.13
requests                2.28.1
requests-oauthlib       1.3.1
rich                    12.6.0
rsa                     4.9
setuptools              59.5.0
shortuuid               1.0.9
six                     1.16.0
soupsieve               2.3.2.post1
tensorboard             2.10.1
tensorboard-data-server 0.6.1
tensorboard-plugin-wit  1.8.1
tokenizers              0.13.1
tomli                   2.0.1
tomlkit                 0.11.5
torch                   1.13.0
torchmetrics            0.7.0
torchvision             0.14.0
tqdm                    4.64.1
transformers            4.23.1
typing_extensions       4.4.0
urllib3                 1.26.12
Werkzeug                2.2.2
wheel                   0.37.1
wrapt                   1.14.1
yarl                    1.8.1
zipp                    3.9.0

Hi @eanson023,

I did not support it officially, and with the latest changes of the code, it might not work properly indeed.

What command line did you use there?