Physical Address
Taipo, Hong Kong
Context is the set of all information needed for current AI processing.
Context usually includes historical data, system prompts, environmental settings, current user’s messages, RAGs, and some related information.
But, a context can contain too much information, that will make AI discard old data and give wrong answers, so all AI have its limitation of context size.
Most AI’s context sizes are from 100K to 1M tokens.
Bigger context size means AI can proceed more data, but not means “smarter”.