torch.sum(inputs_tensor[:, -1] == generation_config.pad_token_id) > 0 IndexError: index -1 is out of bounds for dimension 1 with size 0
mongolu opened this issue · 1 comments
mongolu commented
Description
Use openai provider, agent interactions Chat,
getting error:
agixt-text-generation-webui-1 | Traceback (most recent call last):
agixt-text-generation-webui-1 | File "/app/text-generation-webui/modules/callbacks.py", line 57, in gentask
agixt-text-generation-webui-1 | ret = self.mfunc(callback=_callback, *args, **self.kwargs)
agixt-text-generation-webui-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
agixt-text-generation-webui-1 | File "/app/text-generation-webui/modules/text_generation.py", line 355, in generate_with_callback
agixt-text-generation-webui-1 | shared.model.generate(**kwargs)
agixt-text-generation-webui-1 | File "/app/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
agixt-text-generation-webui-1 | return func(*args, **kwargs)
agixt-text-generation-webui-1 | ^^^^^^^^^^^^^^^^^^^^^
agixt-text-generation-webui-1 | File "/app/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/generation/utils.py", line 1538, in generate
agixt-text-generation-webui-1 | and torch.sum(inputs_tensor[:, -1] == generation_config.pad_token_id) > 0
agixt-text-generation-webui-1 | ~~~~~~~~~~~~~^^^^^^^
agixt-text-generation-webui-1 | IndexError: index -1 is out of bounds for dimension 1 with size 0
agixt-text-generation-webui-1 | Output generated in 0.32 seconds (0.00 tokens/s, 0 tokens, context 0, seed 803901025)
Steps to Reproduce the Bug
chat
Expected Behavior
no error
Operating System
- Linux
- Microsoft Windows
- Apple MacOS
- Android
- iOS
- Other
Python Version
- Python <= 3.9
- Python 3.10
- Python 3.11
Environment Type - Connection
- Local - You run AGiXT in your home network
- Remote - You access AGiXT through the internet
Runtime environment
- Using docker compose
- Using local
- Custom setup (please describe above!)
Acknowledgements
- I have searched the existing issues to make sure this bug has not been reported yet.
- I am using the latest version of AGiXT.
- I have provided enough information for the maintainers to reproduce and diagnose the issue.
Josh-XT commented
Hello, this is an Ooba error. I'm not sure what the error means but you might need to make an issue on their repository.