ibdmchk (1)

ibdmchk has two operation modes: design and verification.

\s-1DESIGN:\s0

ibdmchk [-v][-h][-u][-r <roots file>] -t <topology file> -n <\s-1SM\s0 Node>

  -p <\s-1SM\s0 Port> [-e] [-l <lmc>]

\s-1VERIFICATION:\s0

ibdmchk [-v][-h][-r <roots file>] [-s <subnet file>] [-f <fdb file>]

  [-m <mcfdbs file> [-l <lmc>] [-u] [-M] [-a]
  [-c <path sl file>] [-d <sl2vl tables file>]

The Design mode is intended to be used before the cluster is built. It provides basic checks of the specified network as described by a topology file. After simulating the \s-1SM\s0 \s-1LID\s0 assignment and routing algorithms it provides reports of the (H)CA to (H)CA paths depth histogram and credit deadlock potential in the resulting routing scheme.

-t|--topo <topo file>

The topology file specifying the network. See man ibdm-topology-file

-n|--node <\s-1SM\s0 Node>

The name of the Subnet Manager node (syntax: <Topo-File-System>/U1)

-p|--port <\s-1SM\s0 Port>

The port number by which the \s-1SM\s0 nodes is attached to the fabric.

-v|--verbose

Verbsoe mode

-h|--help

Provides this help message

-l|--lmc <lmc>

\s-1LMC\s0 value > 0 means assigning 2^lmc lids to each port.

-e|--enh

Use enhanced routing algorithm when \s-1LMC\s0 > 0 and report the resulting paths correlation (using same system/node) histogram

-r|--roots <roots file> A file with all the roots node names (one on each line).

After the cluster is built and OpenSM is run (using flag -D 0x43) it reports the subnet and \s-1FDB\s0 tables into the files osm-subnet.lst, osm.fdbs and osm.fdbs in /var/log/ (or subnet.lst, osm.fdbs and osm.mcfdbs into /var/cache/ibutils in older OpenSM versions). ibdiagnet is also producing the same files in its output directory. Based on these files the utility checks all \s-1CA\s0 to \s-1CA\s0 connectivity. Further analysis for credit deadlock potential is performed and reported. In case of an \s-1LMC\s0 > 0 it reports histograms for how many systems and nodes are common between the different paths for the same port pairs.

-l|--lmc <lmc>

The \s-1LMC\s0 value used while running OpenSM. Mandatory if not the default 0.

-v|--verbose

Verbsoe mode

-h|--help

Provides this help message

-s|--subnet <file>

OpenSM subnet.lst file (default is /var/log/osm-subnet.lst or /var/cache/ibutils/subnet.lst)

-f|--fdb <file>

OpenSM dump of Ucast \s-1LFDB\s0. Use -D 0x41 to generate it (default is /var/log/osm.fdbs or /var/cache/ibutils/osm.fdbs).

-m|--mcfdb <file>

OpenSM dump of Multicast \s-1LFDB\s0. Use -D 0x41 to generate it (default is /var/log/osm.mcfdbs or /var/cache/ibutils/osm.mcfdbs).

-c|--psl <file>

Source Guid to \s-1DLID\s0 -> Path \s-1SL\s0 mapping. Each line holds: src_node_guid dlid sl. Used by the credit loop check to accuartly model \s-1SL/VL\s0 based routing.

-d|--slvl <file>

\s-1SL2VL\s0 mapping of all switces. Each line holds: swguid iport oport 0x(sl0)(sl1) 0x(sl2)(sl3)... Used by the credit loop check to accuartly model \s-1SL/VL\s0 based routing.

-r|--roots <roots file>

A file holding all root nodes guids (one per line).

-u|--updn

Use Up/Down based credit loop check algorithm instead of the generic one.

-M|--MFT

Include multicast routing in credit loops analysis.

-a|--all

Verify not only CA-CA paths but also \s-1SW-SW\s0, CA-SW and \s-1SW-CA\s0. Both check for \s-1FDB\s0 path connectivity and also for credit loops.

Eitan Zahavi, Mellanox Technologies \s-1LTD\s0, [email protected]