Together-Java/TJ-Bot

inconsistency in titles generated by GPT

ankitsmt211 opened this issue · 2 comments

Describe the bug

image

as shown in the screenshot, title is quoted sometimes when question is transfered via TransferQuestionCommand, mainly due to inconsistency in response from GPT.
Expected behavior

Title shouldnt have any quotation marks

Additional context

 String chatGptPrompt =
                "Summarize the following text into a concise title or heading not more than 4-5 words, remove quotations if any: %s"
                    .formatted(originalMessage);
        Optional<String> chatGptResponse = chatGptService.ask(chatGptPrompt, "");
        String title = chatGptResponse.orElse(createTitle(originalMessage));
        if (title.length() > TITLE_MAX_LENGTH) {
            title = title.substring(0, TITLE_MAX_LENGTH);
        }

Above piece of code is responsible for generating title in TransferQuestionCommand#onMessageContext, to solve this issue instead of directly assigning generated text from GPT as title, it should be santized by removing quotations if present.

I'd like to work on this, assign it to me.

@arslanaka remove the prompt check and add a manual check #1059 (comment)