[Concept_2]Token

Token is the unit of instruction sent to AI and results from AI.

1 token usually is 1 word of the alphabetical language, but a long word probably be separated into 2 tokens. For character language, 1 token can be 1 or 2 characters, depending on how many characters enough to describe one meaning.

As the tested results from Internet, averagely, 1 token is 0.8 word of alphabetical language, and 1.5 words of character language.

There are 2 types of token: input token and output token.

Input token is word written by user to AI.

Output token is result computed from AI to itself or to user.