I’ve seen some LLM research that indicates it might be “middles” that get forgotten, more than beginnings. In any case, we have observed some agents “forgetting” instructions. The best I can recommend at this time is to keep prompts short by pushing more logic into actions.
Do you have any data about size of prompt where you’ve started to see the problem? Or constraints that would prevent you from pushing logic into actions?