ChatGPT forgets issues in lengthy threads. Right here’s the repair

The most straightforward rationalization I’ve heard for the way an AI remembers issues goes like this: Think about a protracted, slender desk, after which think about that you simply start inserting dominos on one finish, slowly sliding them towards the alternative finish as you add extra.

So, you retain chatting and chatting, inserting extra dominos onto the desk whereas the very first dominos you added slide nearer to the opposite finish. If the dialog goes lengthy sufficient, you’ll begin listening to the clatter of the oldest dominos falling to the ground, as they’re nudged off the desk by the newer dominos.

That’s a really tough description of how context home windows work in AI. At this time’s LLM fashions have restricted context home windows that may fill all the way in which up — and when that occurs, one thing has to go, particularly the very starting of your chat.

Now, the ChatGPT, Claude, and Gemini apps all have strategies for coping with context home windows that get too full, robotically “compacting” a dialog that’s gotten too lengthy. Claude, for instance, will often pause a chat whereas it crams the context right down to a extra manageable measurement.

However even with the most effective AI instruments, you may’t ever inform exactly when they’ll determine to compact a prolonged chat, and whereas some AI apps will allow you to set off a “compress this chat” session (Claude Code and Codex come to thoughts), mainstream AI purposes like ChatGPT usually don’t.

That stated, there’s a approach to manually compact a protracted AI dialog after which hand the distilled nugget to a contemporary chat, basically rebooting the thread (whereas saving valuable AI tokens within the course of).

Now, you could possibly merely ask ChatGPT one thing like this: “Summarize our dialog to this point into a decent 100-word paragraph,” however that dangers dropping necessary nuances, together with crucial forks within the street and even the unique downside you’re attempting to resolve. 

As a substitute, do this immediate (which distills related “compact this chat” prompts floating across the net):

Create a handoff abstract I can paste into a brand new chat. Embrace: what we’re attempting to perform, key selections we’ve made, something necessary you’d get fallacious by guessing, and the very subsequent step. Hold it quick sufficient to learn in below a minute.

This immediate ought to yield a short overview of a protracted dialog that nonetheless carries over an important nuggets of knowledge, good for teeing up a contemporary new chat.

I attempted this immediate for a prolonged dialogue I used to be having with ChatGPT about porting over a basic Apple II role-playing sport to a Raspberry Pi 5 (sure, it’s one other one among my nerdy initiatives). 

Right here’s the response I received:

We’re exploring the best way to get the unique Apple II Wizardry: Proving Grounds of the Mad Overlord working legally on a Raspberry Pi 5, probably by means of Apple II emulation, not by rebuilding the sport from scratch.

Key selections to this point: the Pi 5 is definitely highly effective sufficient; the primary problem will not be {hardware} however authorized entry to the unique Apple II disk/software program. A trustworthy clone or remake can be doable in Godot/Pygame, however the quick objective is the genuine unique Apple II model.

Vital caveat: don’t assume “abandonware” downloads are authorized. Wizardry remains to be a stay IP, and random .dsk/.woz disk photos on-line are in all probability unauthorized. The cleanest authorized choices are both shopping for the trendy licensed remake for gameplay, or shopping for an unique bodily Apple II copy and imaging the disks your self. The latter is essentially the most genuine however might require specialised {hardware} resembling Applesauce or KryoFlux, and previous disks could also be degraded or copy-protected.

Very subsequent step: determine whether or not the objective is genuine Apple II emulation on the Pi or just authorized gameplay. If genuine emulation, analysis present availability/costs for unique Apple II 

Wizardry disks and what {hardware}/software program is required to picture them right into a usable disk picture.

Then I handed off the dialog to a brand new chat thread like so:

Let’s proceed this chat, right here’s the place we left off: [Paste in generated summary]

Give it a attempt the following time your ChatGPT dialog will get too lengthy, and also you’ll assist stop any key context “dominos” from slipping off the desk.