Physical Address
Taipo, Hong Kong
Physical Address
Taipo, Hong Kong
for unprofessional person who need AI
for unprofessional person who need AI
First of all, it depends on using online AI or offline AI.
For online AI, most computers bought within 5 years basically can install and use online AI clients.
So the biggest question is about requirements for offline AI, and the recommended hardwares as below:
Larger AI models need larger RAM:
1B (one billion parameters) size of AI needs about 0.5GB to 2GB size of RAM.
Usually useful AI models contain parameters of about 2B to 128GB as popular ones about 4B to 40B, therefore who will run local AI models better needs a computer with 64GB unified RAM or with powerful GPU which has 64GB RAM.
Faster computing needs newer CPU with more cores.
Much faster computing needs more powerful GPU with at least 12GB RAM.
Recently, my dream machines for AI are Apple M5 Max with 128GB unified RAM, and PC with nVIDIA GPU 128GB RAM.