Length of prompt history becomes negative after being shortened about langroid HOT 5 CLOSED

I made some changes in chat_agent so that all instruction-type text will be in the system msg, so now the first user message should be removable. So in chat_agent I'm changing this part of the code to preserve the sys msg and last msg, repeatedly drop the first msg after the sys msg.

from langroid.

Langroid should try gradually and iteratively to remove messages

This is exactly what it is already doing, and despite dropping all removable messages, the history is longer than model's context length (which implies feasible output len = ModelContextLen - HistLen < 0). It's not really a bug, but I'll catch the negative output len and throw a useful/informative err msg.

from langroid.

Agreed, not a bug. To handle this, I just removed all history messages except the 1st two messages (system and user), but I keep track of minimal info that I provide as a pending message to LLM to answer.

from langroid.

@pchalasani did your recent PR solve this issue?

from langroid.

yes

from langroid.