Forum/AT Fibre Channel

General fabric and switch arrangement

  1. There are two distinct fabrics - fc0* and fc1* - each composed of three interlinked QLogic SANbox 5600 switches.
  2. Each switch has 16 1/2/4-Gb/s fibre channel ports to which clients (servers and disc arrays) are connected, and 4 10-Gb/s XPAK switch interlink ports.
  3. The switch interlinks are arranged as follows:
    Fabric fc0* Fabric fc1*
       
                     +--------------------+
     fc00            |        fc0a        |   +----+
    +================|=+     +============|===|=+  |
    |           16  18 |     |           16  18 |  |
    | 0 ... 15  17  19 |     | 0 ... 15  17  19 |  |
    +============|===|=+     +==================+  |
    |           16  18 |                           |
    | 0 ... 15  17  19 |                           |
    +================|=+                           |
     fc01            +-----------------------------+
    
           FORUM                     AT
    
    
     fc10            +----+
    +================|=+  |
    |           16  18 |  |
    | 0 ... 15  17  19 |  |   fc1a
    +============|===|=+  |  +==================+
    |           16  18 |  |  |           16  18 |
    | 0 ... 15  17  19 |  |  | 0 ... 15  17  19 |
    +================|=+  |  +============|===|=+
     fc11            |    +---------------+   |
                     +------------------------+
    
           FORUM                      AT
    
  4. For multipath redundancy, each client (i.e. each server and disc array) should be connected to both fabrics.

Port usage

For Forum FC switch usage see the relevant rfe file:

  • edge/fc00.ports
  • edge/fc01.ports
  • edge/fc10.ports
  • edge/fc11.ports

Interconnects (10-Gbps Ports)

Port Usage
fc00/16 -
fc00/17 -> fc01/16
fc00/18 -> fc0a/16
fc00/19 -> fc01/18
Port Usage
fc01/16 -> fc00/17
fc01/17 -
fc01/18 -> fc00/19
fc01/19 -> fc0a/18

Interconnects (10-Gbps Ports)

Port Usage
fc10/16 -
fc10/17 -> fc11/16
fc10/18 -> fc1a/17
fc10/19 -> fc11/18
Port Usage
fc11/16 -> fc10/17
fc11/17 -
fc11/18 -> fc10/19
fc11/19 -> fc1a/19

Also see KB Fibre Channel.

Notes:

  1. Machines marked with a '†' are currently fitted with a single fibre port only; they cannot be set up for multipathing.
  2. neilb: "Where I've added a port ie p[012], the number is as indicated on the hardware. Note that some hardware is indexed from 0 and others from 1, eg the Dell servers label them port 1 and port 2, but the Evo's and Nexsan boxes label them host 0 and host1."

-- IanDurkacz - 23 Jun 2010

Topic revision: r32 - 28 Apr 2016 - 10:53:43 - StephenQuinney
DICE.ForumATFibreChannel moved from DICE.ForumFCSwitchPopulation on 26 Oct 2010 - 10:59 by IanDurkacz - put it back
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
This Wiki uses Cookies