powers of four

The ecosystem tends to get out of balance because the hardware tends to run far ahead of what we can develop in terms of software. We have machines that have a tremendous level of parallelism. We currently have a very crude way of doing programming.

Click the link for more -- it's a Q&A with Jack Dongarra about Tianhe-1A, the new 2.5 [sustained] PF machine in China. Other interesting bits are that the interconnect is home grown and roughly twice the bandwidth of Infiniband.