Infinite `max_tokens` in the ChatGPT API?

Did someone forget to update the description of max_tokens?

The description claims that itā€™s 4096 tokens, disagreeing with the ā€œDefaults to infā€ text in the heading.

A mistake, a hint of whatā€™s to come, or both?

Leave a Comment Cancel Reply