BlinkDL/RWKV-LM

为什么生成的内容经常会重复

bigcat26 opened this issue · 1 comments

model是RWKV-4-World-0.1B-v1-20230520-ctx4096。

比如这种

User:Generate a JSON file to describe an automation action.
Assistant:[ To describe an automation action, you can use the `describe` method. Here's an example of how you can use the `describe` method:

describe("User", function () {
  it("should show the user", function () {
    expect(User.findOne({_id: 1}).first()).toEqual({_id: 1});
  });
});
describe("User", function () {
  it("should show the user", function () {
    expect(User.findOne({_id: 1}).first()).toEqual({_id: 1});
  });
});

This will show the user's name, email address, and password. The `User.findOne({_id: 1})` method will return the user's name, email address, and password. The `User.findOne({_id: 1})` method will return the user's email address, password, and password. The `User.find]

还有这种

User:Generate a JSON file to describe an automation action.
Assistant:[ To describe an automation action, you can use the `Actions` module in the `Action` module. Here's an example of how you can create a `Actions` module:

import { Actions } from '@/actions/actions';
const actions = [
  {
    name: 'User',
    email: 'user@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    emailAddress: 'email@example.com',
    password: 'password',
    email]

后面试了,RWKV-4-Raven-1B5-v12-Eng98%-Other2%-20230520-ctx4096

好像会稍微好点。参数量太低就会有这种问题?

https://pypi.org/project/rwkv/
Try:
temperature = 1.0, top_p = 0.3, top_k = 0, alpha_frequency = 1, alpha_presence = 0, alpha_decay = 0.996
For alpha_frequency and alpha_presence, see "Frequency and presence penalties": https://platform.openai.com/docs/api-reference/parameter-details