Efficient Bypass in Mesh and Torus NoCs

by   Ivan Perez, et al.

Minimizing latency and power are key goals in the design of NoC routers. Different proposals combine lookahead routing and router bypass to skip the arbitration and buffering, reducing router delay. However, the conditions to use them requires completely empty buffers in the intermediate routers. This restricts the amount of flits that use the bypass pipeline especially at medium and high loads, increasing latency and power. This paper presents NEBB, Non-Empty Buffer Bypass, a mechanism that allows to bypass flits even if the buffers to bypass are not empty. The mechanism applies to wormhole and virtual-cut-through, each of them with different advantages. NEBB-Hybrid is proposed to employ the best flow control in each situation. The mechanism is extended to torus topologies, using FBFC and shared buffers. The proposals have been evaluated using Booksim, showing up to 75 of the buffered flits for single-flit packets, which translates into latency and dynamic power reductions of up to 30 traffic, these improvements are 20 and 21 bypass utilization is largely independent of the number of VCs when using shared buffers and very competitive with few private ones, allowing to simplify the allocation mechanisms.


Analysing Mechanisms for Virtual Channel Management in Low-Diameter networks

To interconnect their growing number of servers, current supercomputers ...

Intelligent Bandwidth Allocation for Latency Management in NG-EPON using Reinforcement Learning Methods

A novel intelligent bandwidth allocation scheme in NG-EPON using reinfor...

Dynamic Power Allocation and User Scheduling for Power-Efficient and Low-Latency Communications

In this paper, we propose a joint dynamic power control and user pairing...

Routing heterogeneous traffic in delay tolerant satellite networks

Delay Tolerant Networking (DTN) has been proposed as a new architecture ...

Uber: Utilizing Buffers to Simplify NoCs for Hundreds-Cores

Approaching ideal wire latency using a network-on-chip (NoC) is an impor...

Towards "Zero-buffer" Datacenter Networks

In this paper, we investigate the possibility of building a data center ...

Please sign up or login with your details

Forgot password? Click here to reset