EXO
EXO has made an appearance at ElectricBrain. Why ? Well simply put, upgrading the RTX 5060 Ti's 16GB to 32GB is going to cost a fortune. Pretty much the only solution was to upgrade to the RTX 5090, which in the early days was expensive but reasonable (and I didn't known what I was doing). The rest is history. That GPU card started out at a few $AU '000s. Now of course it's closing in on or has passed $AU 18,000.00 thankyou very much.
But ElectricBrain already has 32GB of VRAM across two computers. 16GB in the RTX 5060 Ti and a further 16GB in the RTX 5080 Lenovo laptop. Enter EXO!! The system can now load Gemma4:31B-4bit entirely into GPUs across both nodes' combined VRAM.
Here's what the AI reckons is going on:
