Skip to content

Racking Guidelines

The HyperCloud cluster layout depends upon several variables including cluster size, node composition (storage:compute ratio) and user preference. Below we outline a suggested layout scheme that works well in most cases.

Racking Layout

Suggested layout scheme (working down from the top of rack)

  • Management switch
  • Interconnects
  • Compute Nodes
    • Including hardware accelerated nodes
  • Static Storage Nodes (3)
  • Remaining Storage Nodes

Interconnect Cabling

When connecting the HyperCloud nodes to the interconnects:

  • Connect the eth0 NIC (nearest the PSU) to the upper Interconnect #1.
  • Connect the eth1 NIC (further from the PSU) to the lower Interconnect #2.
  • Connect the MGMT ethernet (center RJ45 port) to the Management switch.

Note

This example assumes a maximum of 18 compute nodes and 18 storage nodes. Depending on the cluster topology deployed, port selection may need to be modified to account for different node counts.

Compute & Storage Nodes

Tip

We suggest using Velcro ties to bundle the cables into groups of four. This will make it easier to manage later

  1. Physical ports 1 - 18 are assigned to storage nodes1

  2. Physical ports 19 - 36 are reserved for the compute nodes1

  3. Physical port 46 is the default port for the uplink to the Management switch (connected ports 50 and 51 of the Management switch respectively)

  4. Physical ports 55 and 56 are bonded to connect the two interconnects:

    • Connect Port 55 on High Speed switch 1 into Port 55 on High Speed switch 2.
    • Connect Port 56 on High Speed switch 1 into Port 56 on High Speed switch 2.

  5. The interconnect management ports can be routed to ports 46, 47, and 48 on the Management interconnect. (This includes connecting the management port on the management interconnect to itself)

  1. The uplink(s) to the customer infrastructure are bonded and use either SFP (25 GbE) or QSFP (100 GbE) ports1
    • SFP / 25 GbE: Physical port 48
    • QSFP / 100 GbE: Physical port 49

Warning

Do not connect the public network uplinks at this stage. The uplinks are connected after the cluster has been configured and booted

Large Image

PSU Cabling

Tip

We suggest placing both the primary and backup PDUs on the left hand side of the rack. This allows short neat routing of the power cables

  1. Once the data connections have been made, the node Power Supply Units (PSUs) can be connected to the rack Power Distribution Unit (PDU).
  2. Do not power on the nodes until the Interconnect Setup has been completed.
  3. The node power up sequence is detailed in the HyperCloud Setup step.

  1. SONiC switch mapping starts the port count at 0 (not 1 as on the physical label). It also counts each of the 100 Gb ports as 4 logical ports. Management and Interconnect ↩↩↩