LowinLi/transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
PythonMIT
Issues
- 1
Token Yielding Problem
#7 opened by xdevfaheem - 1
- 4
spacing problem.
#2 opened by circuluspibo - 0
- 0
ERROR: Could not build wheels for transformers-stream-generator, which is required to install pyproject.toml-based projects
#11 opened by Lizhecheng02 - 0
- 2
do_sample=False
#1 opened by vicwer - 1
- 1
支持bloom吗
#4 opened by kevinuserdd - 1
transformers_stream_generator/main.py:139: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation) warnings.warn(
#5 opened by lucasjinreal - 3
- 5
中文乱码
#6 opened by lucasjinreal