Definitely have talked about the Orin Nano a lot... I'm in no rush to get to the ML stuff... it will be several months. So the Orin Nano is a likely target.
Yea, I'm liking the NUC24OXGv9, has 3x NVMe drives, and can support a discrete GPU. Have it in a distributed dental environment. Pretty neat! Maybe I can make one fall off a truck for ya
To get 30-40 Tokens per Second SLM outputs. GPU with TensorCores helps a lot.
Consider Orix NX 16GB : 100Tops as starting point : 899$
https://www.seeedstudio.com/reComputer-J4012-p-5586.html
Jetson Orin Nano Developer Kit 8GB with 70TOPS for $299 is alternative if you could get one. (newly released and in high demand)
#EdgeFirst #UnovieAI
Definitely have talked about the Orin Nano a lot... I'm in no rush to get to the ML stuff... it will be several months. So the Orin Nano is a likely target.
GPU in a NUC! See what kind of power those little devices can pump out from a localized GPU standpoint. (i.e., Surveillance AI) etc.
Looking forward to seeing how Brian's Edge 2.0 goes!!
Thanks for the thought, Jacob. I am planning to start with a normal NUC, but something with GPU is likely to come as we move down the road!
Yea, I'm liking the NUC24OXGv9, has 3x NVMe drives, and can support a discrete GPU. Have it in a distributed dental environment. Pretty neat! Maybe I can make one fall off a truck for ya