In the context of LLMs, what is a token?
- A security credential for accessing the API
- A fundamental unit of text that the model processes (word parts, punctuation, etc.)
- A form of cryptocurrency used to pay for AI services
- A complete sentence processed by the model