A depiction of the high-level multi-CPU / multi-GPU configurations we evaluate in this paper for a 12-core, 8-GPU, platform. Within each box, individual CPUs (red) and GPUs (blue) are shown on the left and right, respectively. Dashed boxes delineate CPU and GPU clusters (no boxes are used in partitioned cases). The horizontal dashed line across each box denotes the NUMA boundary of the system.