Huh... why is he comparing it to network (cloud) transfers and not to the current CPU-RAM transfers? I thought the benefit of compute-in-memory is reduction of CPU-RAM transfers and that's what they're also saying in the beginning of the article.
Huh... why is he comparing it to network (cloud) transfers and not to the current CPU-RAM transfers? I thought the benefit of compute-in-memory is reduction of CPU-RAM transfers and that's what they're also saying in the beginning of the article.
I am guessing the reason they're targeting edge is because the technology is energy efficient but slow. Any experts can chime in?
For non-battery / line powered devices, thermal design is a big consideration at the edge. Running high powered GPUs in non-environmentally controlled environments is difficult. Low power AI chipsets can help reduce product cost, design cost (simpler thermal designs), and decrease product SWaPs.
He's saying that they can now perform heavier calculations on the edge device using their novel chip design. Currently, these calculations have to be sent to the cloud to perform because chips today can't compute them without wasting too much battery.
For example, Siri has recently implemented on-device AI processing for many queries because the neural engine inside Apple SoCs have gotten so much more powerful and efficient. Previously, all Siri requests were sent to the cloud.[0]
[0]https://www.theguardian.com/technology/2021/jun/07/apple-ove...
This statement is a between-the-lines message to potential partners and investors that they intend to sell to end users and not data centers, and capture that increase in volume.