You must log in or # to comment.
Review demonstrates performance and efficiency have a long way to go
An… AI PC? As in a neural engine or something? Will it help with running LLMs? I’m not sure what that is.
Now I have to look up what an NPU is, what it does and what it’s for. Completely new territory for me. I thought it was all CPUs and GPUs, maybe specialized hardware for mining crypto but NPUs?
unless i’m misunderstanding it, an npu is a vector coprocessor without the graphics stuff
That sounds limited to LLMs.
all machine learning is basically just matrix math.
There are some simulation and math scenarios where it can speed things up while using fraction of power a GPU would, but for general use it is not that usefull.
