TWiki> DICE Web>InfrastructureUnit>ForumATFibreChannel (revision 31)EditAttach

Forum/AT Fibre Channel

General fabric and switch arrangement

  1. There are two distinct fabrics - fc0* and fc1* - each composed of three interlinked QLogic SANbox 5600 switches.
  2. Each switch has 16 1/2/4-Gb/s fibre channel ports to which clients (servers and disc arrays) are connected, and 4 10-Gb/s XPAK switch interlink ports.
  3. The switch interlinks are arranged as follows:
    Fabric fc0* Fabric fc1* 
       
                 +--------------------+
 fc00            |        fc0a        |   +----+
+================|=+     +============|===|=+  |
|           16  18 |     |           16  18 |  |
| 0 ... 15  17  19 |     | 0 ... 15  17  19 |  |
+============|===|=+     +==================+  |
|           16  18 |                           |
| 0 ... 15  17  19 |                           |
+================|=+                           |
 fc01            +-----------------------------+

       FORUM                     AT

    
 fc10            +----+
+================|=+  |
|           16  18 |  |
| 0 ... 15  17  19 |  |   fc1a
+============|===|=+  |  +==================+
|           16  18 |  |  |           16  18 |
| 0 ... 15  17  19 |  |  | 0 ... 15  17  19 |
+================|=+  |  +============|===|=+
 fc11            |    +---------------+   |
                 +------------------------+

       FORUM                      AT
  4. For multipath redundancy, each client (i.e. each server and disc array) should be connected to both fabrics.

Port usage

Fabric fc0* Fabric fc1*
Servers and disc arrays (1/2/4-Gbps FC Ports)
Switch/port Usage
fc00/00 ds35000a p4
fc00/01 ifevo2b p0
fc00/02 crocotta p1
fc00/03 ifevo1a p0
fc00/04 ifevo1b p1
fc00/05 ifevo2a p1
fc00/06 telford
fc00/07 hammersmith p2
fc00/08 metropolitan
fc00/09 ds35000b p4
fc00/10 ~~~ Not used ~~~
fc00/11 mermaid p1
fc00/12 mullo p2
fc00/13 cameleopard p2
fc00/14 ~~~ Not used ~~~
fc00/15 stumer (†)
fc01/00 jubilee p1
fc01/01 phantom
fc01/02 district
fc01/03 squonk p1
fc01/04 bunyip p1
fc01/05 icsa-evo p1
fc01/06 oyster p1
fc01/07 bpbeast p1
fc01/08 kingsmen (†)
fc01/09 circle
fc01/10 satabeast2 p1
fc01/11 satablade p0
fc01/12 dresden
fc01/13 juice p0
fc01/14 ~~~ Not used ~~~
fc01/15 ~~~ Not used ~~~
fc0a/00 ~~~ Not used ~~~
fc0a/01 ~~~ Not used ~~~
fc0a/02 ~~~ Not used ~~~
fc0a/03 ~~~ Not used ~~~
fc0a/04 ~~~ Not used ~~~
fc0a/05 ~~~ Not used ~~~
fc0a/06 ~~~ Not used ~~~
fc0a/07 ~~~ Not used ~~~
fc0a/08 ~~~ Not used ~~~
fc0a/09 ~~~ Not used ~~~
fc0a/10 ~~~ Not used ~~~
fc0a/11 ~~~ Not used ~~~
fc0a/12 ~~~ Not used ~~~
fc0a/13 ~~~ Not used ~~~
fc0a/14 ~~~ Not used ~~~
fc0a/15 ~~~ Not used ~~~

Interconnects (10-Gbps Ports)

Port Usage
fc00/16 -
fc00/17 -> fc01/16
fc00/18 -> fc0a/16
fc00/19 -> fc01/18
Port Usage
fc01/16 -> fc00/17
fc01/17 -
fc01/18 -> fc00/19
fc01/19 -> fc0a/18

Servers and disc arrays (1/2/4-Gbps FC Ports)
Switch/port Usage
fc10/00 satablade p1
fc10/01 ifevo1a p1
fc10/02 ifevo1b p0
fc10/03 bunyip p2
fc10/04 hammersmith p1
fc10/05 district
fc10/06 ifevo2a p0
fc10/07 ~~~ Not used ~~~
fc10/08 phantom
fc10/09 icsa-evo p0
fc10/10 mermaid p2
fc10/11 atabeast1 p1
fc10/12 ~~~ Not used ~~~
fc10/13 telford
fc10/14 ~~~ Not used ~~~
fc10/15 ~~~ Not used ~~~
fc11/00 jubilee p2
fc11/01 ds35000a p3
fc11/02 dresden
fc11/03 circle
fc11/04 bpbeast p0
fc11/05 ifevo2b p1
fc11/06 ~~~ Not used ~~~
fc11/07 metropolitan
fc11/08 oyster p2
fc11/09 ~~~ Not used ~~~
fc11/10 ds35000b p3
fc11/11 hawthorn (†)
fc11/12 cameleopard p1
fc11/13 juice p2
fc11/14 crocotta p2
fc11/15 stockholm (†)
fc1a/00 ~~~ Not used ~~~
fc1a/01 ~~~ Not used ~~~
fc1a/02 ~~~ Not used ~~~
fc1a/03 ~~~ Not used ~~~
fc1a/04 ~~~ Not used ~~~
fc1a/05 ~~~ Not used ~~~
fc1a/06 ~~~ Not used ~~~
fc1a/07 ~~~ Not used ~~~
fc1a/08 ~~~ Not used ~~~
fc1a/09 ~~~ Not used ~~~
fc1a/10 ~~~ Not used ~~~
fc1a/11 ~~~ Not used ~~~
fc1a/12 ~~~ Not used ~~~
fc1a/13 ~~~ Not used ~~~
fc1a/14 ~~~ Not used ~~~
fc1a/15 ~~~ Not used ~~~

Interconnects (10-Gbps Ports)

Port Usage
fc10/16 -
fc10/17 -> fc11/16
fc10/18 -> fc1a/17
fc10/19 -> fc11/18
Port Usage
fc11/16 -> fc10/17
fc11/17 -
fc11/18 -> fc10/19
fc11/19 -> fc1a/19

Also see KB Fibre Channel.

Notes:

  1. Machines marked with a '†' are currently fitted with a single fibre port only; they cannot be set up for multipathing.
  2. neilb: "Where I've added a port ie p[012], the number is as indicated on the hardware. Note that some hardware is indexed from 0 and others from 1, eg the Dell servers label them port 1 and port 2, but the Evo's and Nexsan boxes label them host 0 and host1."

-- IanDurkacz - 23 Jun 2010

Edit | Attach | Print version | History: r32 < r31 < r30 < r29 < r28 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r31 - 28 Apr 2016 - 08:38:38 - StephenQuinney
DICE.ForumATFibreChannel moved from DICE.ForumFCSwitchPopulation on 26 Oct 2010 - 10:59 by IanDurkacz - put it back
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
This Wiki uses Cookies