Coverage of "Ai inference" on cryptobo.eu: the stories and the context behind them.
Etched has secured $800M in funding and $1B in customer contracts for its Sohu chip, a transformer-only ASIC that the company claims outperforms Nvidia's H100 by more than 10x. Andreessen Horowitz is now backing the bet, calling inference the defining compute challenge of this moment.
