LanguageModelSession.GenerationError.exceededContextWindowSize not called

Machine Learning & AI Foundation Models
limtc
limtc OP
Created 1d
Replies 1
Boosts 0
Views 272
Participants 2

When context window size exceeded, this error is not called (instead another error has shown up) to handle new session.

LanguageModelSession.GenerationError.exceededContextWindowSize

Or am I doing things wrong?

Answered by Frameworks Engineer in 847671022

Thanks for flagging this. This is a known issue tracked under 153892731 and it happens only when you are streaming the response.

Replies  1
Boosts  0
Views  272
Participants  2
Apple Staff, Frameworks Engineer
Frameworks Engineer OP
Apple
1d
Recommended

Thanks for flagging this. This is a known issue tracked under 153892731 and it happens only when you are streaming the response.

0
LanguageModelSession.GenerationError.exceededContextWindowSize not called
First post date Last post date
 
 
Q