Category ai

To learn Artificial Intelligence

How to start using AI

Don’t worry about payment of AI before using AI. Recently most of AI provide free account for starters. Users just need to register and type text. You can download and install all of the popular AI apps. Don’t worry about…

Why local AI run slowly?

First of all, take a look at the requirements of the AI model. Usually the small RAM is the limitation for the processing speed. If the computer does not have 16GB or more with bandwidth of higher than 100GB/s, it’s…

What can AI do for you?

AI can do most of works about words, images, calculation, editing, and many more. For business, AI can collect information and give opinions. For office works, AI can analyse data and give summary. For presentation, AI can generate pretty PPT…

Why can a simple question cost a lot of tokens?

A simple question of a few words will cost only several or tens of tokens. After accepting the question, AI will start processing with creating a context window which contains the question, retrieved data from inside or outside, and the…

[Concept_6] Agent

Agent means and is a software do some works automatically after user setting rules. Agent usually is a computer software, as computer is less restricted on permission than mobile phone. Agent provides many functions and options for automatically managing AI…

Why AI models do not work well?

If the computer does not meet the requirements, some AI models and softwares will not work well or run very slowly. First of all, check the specifications of the computer, as most of AI softwares need at least 16GB RAM…

[Concept_5] RAG

RAG is “Retrieval-Augmented Generation”. RAG means telling AI to understand the specified data/information before proceeding. RAG is to ensure AI giving results more targeting and accurate.

[Concept_4] Context

Context is the set of all information needed for current AI processing. Context usually includes historical data, system prompts, environmental settings, current user’s messages, RAGs, and some related information. But, a context can contain too much information, that will make…

What computer is the best for AI

First of all, it depends on using online AI or offline AI. For online AI, most computers bought within 5 years basically can install and use online AI clients. So the biggest question is about requirements for offline AI, and…

Differences between GGUF and MLX

GGUF and MLX both are the format names of AI models. GGUF, GPT-Generated Unified Format, was created by llama.app, for faster, smaller, and better compatibility. MLX, Apple Machine Learning eXtension, is special format only for Apple M series computer.