Skip to content

Commit

Permalink
[CLEANUP]
Browse files Browse the repository at this point in the history
  • Loading branch information
Kye committed Mar 21, 2024
1 parent 214a4ef commit 935d860
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions servers/cogvlm/cogvlm.py
Original file line number Diff line number Diff line change
Expand Up @@ -163,8 +163,8 @@ async def create_chat_completion(
entry = ModelAPILogEntry(
user_id=await fetch_api_key_info(token),
model_id="41a2869c-5f8d-403f-83bb-1f06c56bad47",
input_tokens=await int(count_tokens(request.messages, tokenizer, request.model)),
output_tokens=await int(count_tokens(response["text"], tokenizer, request.model)),
input_tokens=await count_tokens(request.messages, tokenizer, request.model),
output_tokens=await count_tokens(response["text"], tokenizer, request.model),
all_cost=await calculate_pricing(
texts=[message.content], tokenizer=tokenizer, rate_per_million=15.0
),
Expand Down

0 comments on commit 935d860

Please sign in to comment.