The 8-slot Nexus 9508 Switch Review

As one of the Cisco Nexus 9500 modular switches, the 8-slot Nexus 9508 switch is the first available platform in the family that will be followed by the 4-slot and 16-slot platforms.

Cisco Nexus 9508 Switch

The Cisco Nexus 9508 switch supports up to 1152 10GE ports or 288 40GE ports. The Cisco Nexus 9516 switch will double the port densities. The Cisco Nexus 9500 Series Switches share a common modular architecture that consists of switch chassis, supervisors, system controllers, fabric modules, line cards, power supplies, and fan trays.

Cisco Nexus 9508 Chassis and Forwarding Characteristics

Metric Cisco Nexus 9508
Height 13 RU
Supervisor Slots 2
Fabric Module Slots 6
I/O Module Slots 8
Maximum Fabric Bandwidth per Slot 3.84 Tbps
Maximum Fabric Bandwidth per System 30 Tbps
Maximum Number of 10-Gbps Ports 1152
Maximum Number of 40-Gbps Ports 288
Maximum Forwarding Throughput per Line Card 2.88 Tbps
Maximum Forwarding Throughput per System 23.04 Tbps
Air Flow Front-to-Back
Power Supplies 4 x 3 KW AC PSUs
Fan Trays 3

The chassis of the Cisco Nexus 9500 Series has an innovative midplane-free design. A midplane or passive midplane is commonly used in modular platform designs as a way to provide connectivity between line cards and fabric modules. The Cisco Nexus 9500 Series is the industry-first switch platform that eliminates the need for a chassis midplane. With a precise alignment mechanism, Cisco Nexus 9500 Series line cards and fabric modules directly attach to each other with connecting pins. Line cards and fabric modules have orthogonal orientations in the chassis so that each fabric module is connected to all line cards and vice versa. Without a midplane blocking the airflow path, the chassis delivers highly efficient cooling. It also allows a compact chassis design without the need for large cooling fans.

Cisco Nexus 9500 Midplane-Free Chassis Design

Nexus 9500 Midplane-free Chassis Design

In addition to the high cooling efficiency, the Cisco Nexus 9500 Series also leads with high power efficiency. Its power supplies are certified for the industry highest efficiency standard, 80 Plus Platinum, with 90-94 percent power efficiency across all workloads.

Under the supervisor modules are eight power supply slots capable of supplying 3000 watts of AC power each; however, only two are needed to power a fully populated chassis. An additional two power supplies can be used for redundancy in a 2-plus-1 or 2-plus-2 configuration. The remaining four slots provide power headroom for later migration to support 100 Gbps and another generation of application-specific integrated circuits (ASICs).

Line cards and fabric modules of the Cisco Nexus 9500 Series are designed with minimal number of ASICs, a mix of 28-nanometer Cisco and 40-nanometer Broadcom custom and merchant ASICs, respectively that reduces the number of heat pockets on a module.

The combined result of all these innovations is extremely low power consumption per port.

Cisco Nexus 9508 Power Consumption

Port Speed 10 Gbps 40 Gbps
Watts per Port ~3.85 ~15

Both line cards and fabric modules of the Cisco Nexus 9500 Series are equipped with multiple network forwarding engines that perform packet lookup, processing, and forwarding. The fabric module for the Cisco Nexus 9508 has two network forwarding engines.

Each network forwarding engine is built with 32 40-Gbps links and a core switching capacity of 1.44 billion packets per second for even the smallest packet of 64 bytes.

The network forwarding engines use a combination of dedicated ternary content addressable memory (TCAM) table space and shared hash table memory to store Layer 2 and Layer 3 forwarding information. This shared hash table can be programmed in variable modes to provide different memory allocations for the three information tables.

Dedicated and Shared Table Resources for Layer 2 and Layer 3 Forwarding

Dedicated and Shared Table Resources for Layer 2 and Layer 3 Forwarding

To further increase the system wide forwarding scalability, the Cisco Nexus 9500 Series Switches are designed to use tables on line cards and fabric modules for different forwarding lookup functions. The line cards store the Layer 2 MAC table and Layer 3 host table; therefore line cards are responsible for Layer 2 switching lookup and Layer 3 host routing lookup. The fabric modules host Layer 3 LPM tables, and fabric modules perform Layer 3 LPM routing lookup. Both line cards and fabric modules have multicast tables and take a part in distributed multicast lookup and packet replication. Figure 4 depicts the system wide forwarding scalability of Cisco Nexus 9500 Series Switches.

Cisco Nexus 9500 Series Systemwide Forwarding Scalability

Cisco Nexus 9500 Series Systemwide Forwarding Scalability

 

Cisco Nexus 9500 Series Fabric Module

A Cisco Nexus 9508 Switch can have up to six fabric modules that all function in active mode.

The fabric module of Cisco Nexus 9500 Series Switches performs the following functions in the modular chassis architecture:

  1. • It provides high-speed nonblocking data forwarding connectivity for line cards. All links on network forwarding engines are active data paths. Each fabric module can provide up to 8 40-Gbps links to every line card slot. A Cisco Nexus 9500 chassis deployed with 6 fabric modules can potentially obtain 48 40-Gbps fabric paths for every line card slot. That is equivalent to 3.84 Tbps full duplex bandwidth per slot.
  2. • It performs distributed longest-prefix match (LMP) routing lookup for IPv4 and IPv6 traffic. LPM forwarding information is stored on fabric modules on a Cisco Nexus 9500 Series Switch. It supports up to 128,000 IPv4 prefixes or 32,000 IPv6 prefixes.
  3. • It performs distributed multicast lookup and packet replication to send copies of multicast packets to receiving egress line cards.

 

Cisco Nexus 9500 Series Line Card Architecture

Network forwarding engines on a Cisco Nexus 9500 Series Switch line card perform ingress pipeline and egress pipeline packet processing.

Network forwarding engines on line cards conduct Layer 2 switching lookup and Layer 3 host routing lookup. Line cards are equipped with a sufficient number of network forwarding engines and fabric ports to support line-rate forwarding performance for all IP packet sizes.

36-Port 40-Gbps QSFP Line Card

The Cisco line card with product number N9K-X9636PQ (Figure 5) provides 36 40-Gbps Quad Small Form-Factor Pluggable (QSFP) front-panel ports. It has three network forwarding engines for packet forwarding; each supports 12 40-Gbps front-panel ports. The entire line card has a physical-layer-free (PHY-less) design. This reduces the data transport latency on the port by 100 nanoseconds, decreases the port power consumption, and improves reliability with a line card design of fewer active components.

Cisco Nexus 9500 Series 36-Port 40-Gbps QSFP Line Card

Cisco Nexus 9500 Series 36-Port 40-Gbps QSFP Line Card

 

48-Port 1-Gbps or 10-Gbps SFP+ Line Card

The Cisco line card with product number N9K-X9564PX (Figure 6) provides 48 1-Gpbs or 10-Gbps Enhanced Small Form-Factor Pluggable (SPF+) ports and 4 40-Gbps QSFP ports.

There are two network forwarding engines on this line card. One supports the 48 1-Gbps or 10-Gbps front-panel ports and the other supports the 4 40-Gbps ports.

Because of the port speed flexibility, the front-panel ports can be operating at different speeds. Speed mismatch is one of the top reasons for port congestion and packet buffering. To accommodate this additional need for buffer, the line card is built with two extended processors, each offering an additional 40 MB packet buffer space while operating in a pass-through mode along the data path between a network forwarding engine and fabric modules. Transit traffic between front-panel ports and fabric modules, as well as locally switched traffic from a 10-Gbps port to a 1-Gbps port, can take advantage of the extended buffer space.

Cisco Nexus 9500 Series 48-Port 1-Gbps or 10-Gbps SPF+ Line Card

Cisco Nexus 9500 Series 48-Port 1-Gbps or 10-Gbps SPF+ Line Card

 

48-Port 1-Gbps or 10BASE-T Line Card

The Cisco line card with product number N9K-X9564TX (Figure 7) provides 48 1-Gbps or 10BASE-T ports and 4 40-Gbps QSFP ports.

Cisco Nexus 9500 Series 48-Port 1-Gbps or 10BASE-T Line Card

Cisco Nexus 9500 Series 48-Port 1-Gbps or 10BASE-T Line Card

Cisco Nexus 9508 Power Consumption Analysis

This section illustrates the power consumption of the Cisco Nexus 9508 system with different configurations and under different types of loads.

A typical configuration may consist of the following components:

  • 3 fan trays
  • 6 fabric cards
  • 2 supervisors
  • 2 system controllers
  • 2 x 36 x 40-Gbps line cards

Nexus 9508 Power Consumption (Typical) with 2x 40 GigE Line Cards

Component Power Draw Quantity Extended
Fan 176 W 3 528 W
Fabric 176 W 6 1056 W
Supervisor 69 W 2 138 W
System Controller 13 W 2 26 W
36 x 40-Gbps Line Cards 260 W 2 520 W
Total 2268 W

A fully loaded configuration consists of the following components:

  • 3 fan trays
  • 6 fabric cards
  • 2 supervisors
  • 2 system controllers
  • 8 x 36 x 40-Gbps line cards

Cisco Nexus 9508 Power Consumption (Typical) with Fully Loaded System

Component Power Draw Quantity Extended
Fan 176 W 3 528 W
Fabric 176 W 6 1056 W
Supervisors 69 W 2 138 W
System Controller 13 W 2 26 W
36 x 40-Gbps Line Cards 260 W 8 2080 W
Total 3828 W

At a 100 percent line rate, the power consumption for such a system goes to 5470 watts in the worst-case scenario of 64-byte packets and to 4746 watts for traffic with a mix of packet sizes.

The Nexus 9500 Switches are industry-leading data center class switches offering high port density for 1-, 10-, 40-, and future 100 Gbps connectivity and true line rate and low latency forwarding performance.

The midplane-free chassis design enables cooling efficiency. The combination of merchant and custom silicon allows the line cards to have few ASICs while providing record-setting performance, resulting in the lowest number of heat sinks in the system. With these innovations, the front-to-rear airflow, and its 80 Plus Platinum certified highly efficient power supplies, the Cisco Nexus 9500 Series Switches set a record for energy efficiency for data center – class switches.

The Cisco Nexus 9508 Switch provides high-density 40 Gigabit Ethernet in the data center with the best possible power consumption and latency figures even with a fully loaded system under stress, as demonstrated by the RFC test results.

More info from http://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/solution-brief-c22-730049.html

 

More Related Cisco Nexus Switch Topics

Cisco 9500 Nexus Switch Overview-Model Comparison


Cisco Nexus 9000 Series Switches Overview

Cisco Nexus 9000 Models Comparison: Nexus 9500 & Nexus 9300 Series

Nexus 9000 vs. Nexus 7000

Nexus 7000 and Catalyst 6500 Comparison Guide

Cisco Nexus 3100, Ready to Support VMware NSX?

Cisco Nexus 6000 Switches: High-Density, Compact Form Factor

Share This Post

Post Comment