The data has to go across PCI / USB to get to the internal (tiny) SRAM. It's not a good choice for clustering, you should just use a GPU for that.

It has a tiny amount, I believe it was 8MiB. That's Mega, not Giga.

Dont know, sorry. But the performance is not that awesome, but works well enough for my setup doing realtime object detection with a few cameras.

My main reason for getting one was power efficency compared to a traditional GPU for this task.

I have a Coral M.2 and an Intel Xe iGPU on the same machine. Both passthrough to VM, Proxmox, iGPU with SR-IOV. On Proxmox I can see power usage of one camera for SR-IOV device utilizing intel_gpu_top: less than 0.1W.

iGPU for detection? Whats the performance on that?

Sounds cool but for me that would mean more upgrades for that server.

Coral runs on 0.5 watts , which is way less than the geforce 1080 i used before.

Video uses 0.07W at 0,6% Video according to intel_gpu_top

Idle is IIRC 0.01W.