Yes. It’s always the bandwidth that’s the main bottleneck, whether CPU-Memory, IPC, or the network.
Screw quantum computers; what we need is quantum entangled memory sharing at a distance. Imagine! Even if only within a single computer, all memory could could be L1 cache.
Some modern workloads can take advantage of multiple computers. You can usually compile using things like distcc and spread the load across them.
If you make them into a Kubernetes cluster you can run many copies or many different things.
It’s still an unsolved problem: we still end up with single core bottlenecks to this day, before even involving other machines altogether.
Yes. It’s always the bandwidth that’s the main bottleneck, whether CPU-Memory, IPC, or the network.
Screw quantum computers; what we need is quantum entangled memory sharing at a distance. Imagine! Even if only within a single computer, all memory could could be L1 cache.