Alejandro Piad Morffis (@apiad)

Thanks Terry, you're always too kind ;) Technically you can sustain a continuous chat for close to 100 thousand tokens for most frontier models, but what will happen in large chats is the nuance gets lost the more you talk, because models are very good at needle-in-a-haystack retrieval (pinpointing one specific claim in this large past context) but very bad at getting a general overview of a large context, which is almost always what you want in long conversations.