Move Token Count Logging from XT.py to Agent.py
Closed this issue · 0 comments
Josh-XT commented
The task involves moving the token count logging functionality from XT.py to Agent.py within the inference function. The chat completions function in XT.py should calculate total input and output tokens for the user before proceeding. Then, it needs to compare the difference and set the input and output tokens for the response before output. This change aims to centralize the logging mechanism and enhance maintainability.