[roncesvalles]

That slot is called USB-C. I can fully imagine inference ASICs coming in powerbank form factor that you'd just plug and play.

[bagful]

Like the chip-software in Gibson’s sprawl, from the micro-soft to the ROM cowboy to the Aleph, the endgame of computertool distribution is via single-use chunks of quasi-biological computronium

[avisser]

Michael Bay just read "computronium" and spawned an 8 movie franchise in his head.

[zupa-hu]

This would be a hell of a hot power bank. It uses about as much power as my oven. So probably more like inside a huge cooling device outside the house. Or integrated into the heating system of the house.

(Still compelling!)

[fennecbutt]

*the whole server uses 2.2kw or whatever, not a single board. I think that was for 8 boards or something.

[ekianjo]

Not if you need 200w power to run inference.

[stavros]

USB-C can do up to 240W. These days I power all my devices with a USB hub, even my Lipo charger.

[XorNot]

Pretty sure it'd just be a thumbdrive. Are the Taalas chips particularly large in surface area?

[dmurray]

The only product they've announced at the moment [0] is a PCI-e card. It's more like a small power bank than a big thumb drive.

But sure, the next generation could be much smaller. It doesn't require battery cells, (much) heat management, or ruggedization, all of which put hard limits on how much you can miniaturise power banks.

[0] https://taalas.com/the-path-to-ubiquitous-ai/

[thesz]

800 mm2, about 90mm per side, if imagined as a square. Also, 250 W of power consumption.

The form factor should be anything but thumbdrive.

[layla5alive]

Yes, bigger than a 5090's GB202 ASIC! :)

[amelius]

> USB-C

With these speeds you can run it over USB2, though maybe power is limiting.

[GTP]

You would likely need external power anyway.

[Hendrikto]

USB-C is just a form factor and has nothing to do with which protocol you run at which speeds.