Ok, if you don't use their web site you won't see the UX dark patterns. Trust us, they there and fit with the overall garbagefication theme. Annoys the living shit out of me. At least no more Prime Video UI and ad trainwreck.
If you haven't noticed, you've been not paying attention. I canceled Prime a while ago and they try very hard to get you back. And they try to sneak on you billed expedited shipping when over minimum gratis shipping quota. Dark patterns galore.
It would be a major pain for me to boycott them completely so I don't, yet.
A free running cellular automaton (CA) approach in hardware would work, but each cell would be a much souped up SRAM cell, the interactions would be all local and 2D. Considering Cerebras is 40 G SRAM on the 300 mm WSI and is about at the cooling limit I'm afraid you do not have 5 orders of magnitude. Perhaps reversible spintronics can help with the power draw, but you still have to splat a higher dimensional network so not just local interactions into a 2D array.
You seem to not be using open source software packaged for multiple architectures or which can be built for your binary target. Most people will be just using a browser and an office suite.
I would look into thin clients and Lenovo etc. tiny PC for office on eBay. I run old low power low noise rackmount Supermicros which are nice but hard to find at low prices.
Yes orders of magnitude, but not too many of them. The real estate of a 300 mm wafer is limited, the structure shrink is saturating and you can't get too many layers. You still need a packet switched network on the wafer even if the rest is mostly analog. Perhaps spintronics can limit the power requirements too.
There are diminishing returns in semiconductor photolitho. Moore scaling is long over, absolute real estate see WSI with Cerebras, DC costs and power envelope are all sending a clear message. Quantization is there, so you can go from digital multipliers to analog and go spiking networks, but transformers and Co have little power there.
Also, the kind of economy that can carry Gen AI as business model is not a given, long term.