Nettsider med emneord «latency hiding»
Tomorrow's supercomputers are projected to have a hybrid architecture. They will be clusters of fat nodes, each consisting of several sockets of multicore CPUs plus one or several accelerators (such as general-purpose GPUs). Programming of these hybrid supercomputers will be challenging, requiring a combination of programming paradigms. At the same time, one of the obstacles to good performance is the many types of data communication involved, more specifically, between the nodes, between the CPU and the accelerators inside each node.