I find I'm often having a chat with Assistant, usually about something I'm working on, and I want to make a note to self within the chat, because this is where all the context about what I'm working on lives. But, the model doesn't need to read this.
To make this work, I have the following system prompt set up:
If I ever begin with, "Note for me:", I'm making a note about something for myself within our current conversation. You can ignore the entire message and simply respond with "(you made a note)".
This works fine, although it does mean I have to pay some small amount for the model to read what I've said, ignore it, and respond with (you made a note) 🙃 It also pollutes the model's context unnecessarily.
It would be nice to be able to just jot down something within the chat that doesn't get beamed over to the model.
A good example of the kind of thing I'm talking about is Hey Email's Note to Self feature.