[ofa-general] ibping fails in loopback mode

Discussion:

Dukle, Kapil (GE Healthcare)

2007-03-19 22:36:44 UTC

Hi all,

I'm having trouble getting ibping to work in loopback node. The original
config is to connect first port of Blade 1 with first port of Blade 2.
For my loopback test, I have connected the Infiniband cable between the
2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the blade.
Ping succeeds to the first active port, but fails
for the second one. See below...

Why is the ibping to the second active (and linkup) port failing? Am I
missing something? The version is OFED1.0

[***@XXXX]# ps -elf | grep opensm
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 /usr/sbin/opensm
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm

[***@XXXX]# ibping -v -S &
[1] 5445
[***@vre sdc]# ibwarn: [5445] ibping_serv: starting to serve...

[***@XXXX]# ps -elf | grep ibping
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 ibping -v -S
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping

[***@XXXX]# sminfo
sminfo: sm lid 0x3 sm guid 0x3ba00010027d9, activity count 203459
priority 1 state SMINFO_MASTER 3

[***@XXXX]# ibstat
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
Port 1:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
Port 2:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da

[***@XXXX]# ibping -v 3
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.111 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2

--- vre.(none) (Lid 0x3) ibping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2320 ms
rtt min/avg/max = 0.069/0.089/0.111 ms

[***@XXXX]# ibping -v 1
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2

--- (Lid 0x1) ibping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 11358 ms
rtt min/avg/max = 0.000/0.000/0.000 ms

Thanks,
Kapil

Sasha Khapyorsky

2007-03-19 22:56:51 UTC

Permalink

Post by Dukle, Kapil (GE Healthcare)
Hi all,
I'm having trouble getting ibping to work in loopback node. The original
config is to connect first port of Blade 1 with first port of Blade 2.
For my loopback test, I have connected the Infiniband cable between the
2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the blade.
Ping succeeds to the first active port, but fails
for the second one. See below...
Why is the ibping to the second active (and linkup) port failing? Am I
missing something? The version is OFED1.0
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 /usr/sbin/opensm
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm
[1] 5445

I guess you need to start ibping server for both ports (with -C, -P), so
each one will answer "ping".

Sasha

Post by Dukle, Kapil (GE Healthcare)
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 ibping -v -S
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping
sminfo: sm lid 0x3 sm guid 0x3ba00010027d9, activity count 203459
priority 1 state SMINFO_MASTER 3
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.111 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2
--- vre.(none) (Lid 0x3) ibping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2320 ms
rtt min/avg/max = 0.069/0.089/0.111 ms
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2
--- (Lid 0x1) ibping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 11358 ms
rtt min/avg/max = 0.000/0.000/0.000 ms
Thanks,
Kapil
_______________________________________________
general mailing list
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general

Dukle, Kapil (GE Healthcare)

2007-03-20 19:44:08 UTC

Permalink

Hi all,

I was wondering if there are any tools specific for
Infiniband-performance measurement - throughput, round trip time with
adjustable
packet sizes.

________________________________

From: Dukle, Kapil (GE Healthcare)
Sent: Monday, March 19, 2007 5:37 PM
To: ***@lists.openfabrics.org; openib-***@openib.org
Subject: ibping fails in loopback mode

Hi all,

I'm having trouble getting ibping to work in loopback node. The original
config is to connect first port of Blade 1 with first port of Blade 2.
For my loopback test, I have connected the Infiniband cable between the
2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the blade.
Ping succeeds to the first active port, but fails
for the second one. See below...

Why is the ibping to the second active (and linkup) port failing? Am I
missing something? The version is OFED1.0

[***@XXXX]# ps -elf | grep opensm
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 /usr/sbin/opensm
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm

[***@XXXX]# ibping -v -S &
[1] 5445
[***@vre sdc]# ibwarn: [5445] ibping_serv: starting to serve...

[***@XXXX]# ps -elf | grep ibping
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 ibping -v -S
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping

[***@XXXX]# sminfo
sminfo: sm lid 0x3 sm guid 0x3ba00010027d9, activity count 203459
priority 1 state SMINFO_MASTER 3

[***@XXXX]# ibstat
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
Port 1:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
Port 2:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da

[***@XXXX]# ibping -v 3
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.111 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2

--- vre.(none) (Lid 0x3) ibping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2320 ms
rtt min/avg/max = 0.069/0.089/0.111 ms

[***@XXXX]# ibping -v 1
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2

--- (Lid 0x1) ibping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 11358 ms
rtt min/avg/max = 0.000/0.000/0.000 ms

Thanks,
Kapil

Scott Weitzenkamp (sweitzen)

2007-03-20 19:46:55 UTC

Permalink

Look in the OFED perftest RPM (documentation is in
/usr/local/ofed/docs/PERF_TEST_README.txt):

# rpm -qli perftest
Name : perftest Relocations: (not
relocatable)
Version : 1.2 Vendor: OpenFabrics
Release : 0 Build Date: Wed 14 Mar 2007
09:21:36
AM PDT
Install Date: Thu 15 Mar 2007 08:26:42 PM PDT Build Host:
svbu-qa1850-1.cis
co.com
Group : System Environment/Libraries Source RPM:
ofa_user-1.2-beta1.src.
rpm
Size : 262469 License: GPL/BSD
Signature : (none)
URL : http://www.openfabrics.org/
Summary : IB Performance tests
Description :
gen2 uverbs microbenchmarks
/usr/local/ofed/bin/ib_clock_test
/usr/local/ofed/bin/ib_rdma_bw
/usr/local/ofed/bin/ib_rdma_lat
/usr/local/ofed/bin/ib_read_bw
/usr/local/ofed/bin/ib_read_lat
/usr/local/ofed/bin/ib_send_bw
/usr/local/ofed/bin/ib_send_lat
/usr/local/ofed/bin/ib_write_bw
/usr/local/ofed/bin/ib_write_bw_postlist
/usr/local/ofed/bin/ib_write_lat
/usr/local/ofed/bin/runme

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems

________________________________

From: general-***@lists.openfabrics.org
[mailto:general-***@lists.openfabrics.org] On Behalf Of Dukle, Kapil
(GE Healthcare)
Sent: Tuesday, March 20, 2007 12:44 PM
To: ***@lists.openfabrics.org; openib-***@openib.org
Subject: [ofa-general] Tools for Infiniband Performance
measurement

Hi all,

I was wondering if there are any tools specific for
Infiniband-performance measurement - throughput, round trip time with
adjustable
packet sizes.

________________________________

From: Dukle, Kapil (GE Healthcare)
Sent: Monday, March 19, 2007 5:37 PM
To: ***@lists.openfabrics.org; openib-***@openib.org
Subject: ibping fails in loopback mode

Hi all,

I'm having trouble getting ibping to work in loopback node. The
original config is to connect first port of Blade 1 with first port of
Blade 2.
For my loopback test, I have connected the Infiniband cable
between the 2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the
blade. Ping succeeds to the first active port, but fails
for the second one. See below...

Why is the ibping to the second active (and linkup) port
failing? Am I missing something? The version is OFED1.0

[***@XXXX]# ps -elf | grep opensm
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 /usr/sbin/opensm
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm

[***@XXXX]# ibping -v -S &
[1] 5445
[***@vre sdc]# ibwarn: [5445] ibping_serv: starting to serve...

[***@XXXX]# ps -elf | grep ibping
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 ibping -v -S
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping

[***@XXXX]# sminfo
sminfo: sm lid 0x3 sm guid 0x3ba00010027d9, activity count
203459 priority 1 state SMINFO_MASTER 3

[***@XXXX]# ibstat
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
Port 1:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
Port 2:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da

[***@XXXX]# ibping -v 3
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.111 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2

--- vre.(none) (Lid 0x3) ibping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2320 ms
rtt min/avg/max = 0.069/0.089/0.111 ms

[***@XXXX]# ibping -v 1
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2

--- (Lid 0x1) ibping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 11358
ms
rtt min/avg/max = 0.000/0.000/0.000 ms

Thanks,
Kapil

Michael S. Tsirkin

2007-03-20 20:55:35 UTC

Permalink

git://git.openfabrics.org/~mst/perftest.git

Quoting Dukle, Kapil (GE Healthcare) <***@med.ge.com>:
Subject: Tools for Infiniband Performance measurement

Hi all,

I was wondering if there are any tools specific for
Infiniband-performance measurement - throughput, round trip time with
adjustable
packet sizes.

________________________________

From: Dukle, Kapil (GE Healthcare)
Sent: Monday, March 19, 2007 5:37 PM
To: ***@lists.openfabrics.org; openib-***@openib.org
Subject: ibping fails in loopback mode

Hi all,

I'm having trouble getting ibping to work in loopback node. The original
config is to connect first port of Blade 1 with first port of Blade 2.
For my loopback test, I have connected the Infiniband cable between the
2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the blade.
Ping succeeds to the first active port, but fails
for the second one. See below...

Why is the ibping to the second active (and linkup) port failing? Am I
missing something? The version is OFED1.0

[***@XXXX]# ps -elf | grep opensm
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 /usr/sbin/opensm
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm

[***@XXXX]# ibping -v -S &
[1] 5445
[***@vre sdc]# ibwarn: [5445] ibping_serv: starting to serve...

[***@XXXX]# ps -elf | grep ibping
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 ibping -v -S
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping

[***@XXXX]# sminfo
sminfo: sm lid 0x3 sm guid 0x3ba00010027d9, activity count 203459
priority 1 state SMINFO_MASTER 3

[***@XXXX]# ibstat
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
Port 1:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
Port 2:
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da

[***@XXXX]# ibping -v 3
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.111 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2

--- vre.(none) (Lid 0x3) ibping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2320 ms
rtt min/avg/max = 0.069/0.089/0.111 ms

[***@XXXX]# ibping -v 1
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2

--- (Lid 0x1) ibping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 11358 ms
rtt min/avg/max = 0.000/0.000/0.000 ms

Thanks,
Kapil

--
MST

Kyle Schochenmaier

2007-03-20 21:43:03 UTC

Permalink

Post by Dukle, Kapil (GE Healthcare)
Hi all,
I was wondering if there are any tools specific for
Infiniband-performance measurement - throughput, round trip time with
adjustable
packet sizes.

The latest NetPIPE benchmarking utility has Infiniband support:
It will measure what you asked.

http://source.scl.ameslab.gov/NetPIPE/NetPIPE_3.7.tar.gz

Kyle

Post by Dukle, Kapil (GE Healthcare)
------------------------------------------------------------------------
*From:* Dukle, Kapil (GE Healthcare)
*Sent:* Monday, March 19, 2007 5:37 PM
*Subject:* ibping fails in loopback mode
Hi all,
I'm having trouble getting ibping to work in loopback node. The
original config is to connect first port of Blade 1 with first port of
Blade 2.
For my loopback test, I have connected the Infiniband cable between
the 2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the blade.
Ping succeeds to the first active port, but fails
for the second one. See below...
Why is the ibping to the second active (and linkup) port failing? Am
I missing something? The version is OFED1.0
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 */usr/sbin/opensm*
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm
*[1] 5445
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 *ibping -v -S*
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping
*sminfo: sm lid 0x3* sm guid 0x3ba00010027d9, activity count 203459
priority 1 state SMINFO_MASTER 3
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3*
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1*
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
*Pong from vre.(none) (Lid 0x3): time 0.111 ms*
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2
--- vre.(none) (Lid 0x3) ibping statistics ---
*3 packets transmitted, 3 received, 0% packet loss, time 2320 ms*
rtt min/avg/max = 0.069/0.089/0.111 ms
ibwarn: [5449] ibping: Ping..
*ibwarn: [5449] main: ibping to Lid 0x1 failed*
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2
--- (Lid 0x1) ibping statistics ---
*3 packets transmitted, 0 received, 100% packet loss, time 11358 ms*
rtt min/avg/max = 0.000/0.000/0.000 ms
Thanks,
Kapil
!DSPAM:46003995205571657414402!
------------------------------------------------------------------------
_______________________________________________
general mailing list
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
!DSPAM:46003995205571657414402!

--
Kyle Schochenmaier
***@scl.ameslab.gov
Research Assistant, Dr. Brett Bode
AmesLab - US Dept.Energy
Scalable Computing Laboratory

Jeff Squyres

2007-03-20 21:44:38 UTC

Permalink

Note that NetPIPE 3.7 will only use the first port of the first HCA
in your machine (which is a fairly common configuration).

I have submitted a patch to the NetPIPE maintainers that allows you
to specify on the command which port / HCA to use for testing.

Post by Kyle Schochenmaier

Post by Dukle, Kapil (GE Healthcare)
Hi all,
I was wondering if there are any tools specific for Infiniband-
performance measurement - throughput, round trip time with adjustable
packet sizes.

It will measure what you asked.
http://source.scl.ameslab.gov/NetPIPE/NetPIPE_3.7.tar.gz
Kyle

Post by Dukle, Kapil (GE Healthcare)
---------------------------------------------------------------------
---
*From:* Dukle, Kapil (GE Healthcare)
*Sent:* Monday, March 19, 2007 5:37 PM
*Subject:* ibping fails in loopback mode
Hi all,
I'm having trouble getting ibping to work in loopback node. The
original config is to connect first port of Blade 1 with first
port of Blade 2.
For my loopback test, I have connected the Infiniband cable
between the 2 ports on the same Linux blade.
Both opensm and ibping (server mode) seem to be running on the
blade. Ping succeeds to the first active port, but fails
for the second one. See below...
Why is the ibping to the second active (and linkup) port
failing? Am I missing something? The version is OFED1.0
4 S root 3078 1 0 76 0 - 19039 stext Mar16 ?
00:00:09 */usr/sbin/opensm*
4 S root 5444 5424 0 77 0 - 13981 pipe_w 17:22 pts/1
00:00:00 grep opensm
*[1] 5445
4 S root 5445 5424 0 77 0 - 1454 - 17:22 pts/1
00:00:00 *ibping -v -S*
4 S root 5447 5424 0 77 0 - 13982 - 17:22 pts/1
00:00:00 grep ibping
*sminfo: sm lid 0x3* sm guid 0x3ba00010027d9, activity count
203459 priority 1 state SMINFO_MASTER 3
CA 'mthca0'
CA type: MT25208 (MT23108 compat mode)
Number of ports: 2
Firmware version: 4.7.400
Hardware version: a0
Node GUID: 0x0003ba00010027d8
System image GUID: 0x0003ba00010027db
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 3*
LMC: 0
SM lid: 3
Capability mask: 0x02510a6a
Port GUID: 0x0003ba00010027d9
State: Active
Physical state: LinkUp
Rate: 10
Base lid: 1*
LMC: 0
SM lid: 3
Capability mask: 0x02510a68
Port GUID: 0x0003ba00010027da
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
*Pong from vre.(none) (Lid 0x3): time 0.111 ms*
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.087 ms
ibwarn: [5452] ibping: Ping..
ibwarn: [5445] ibping_serv: Pong: vre.(none)
Pong from vre.(none) (Lid 0x3): time 0.069 ms
ibwarn: [5452] report: out due signal 2
--- vre.(none) (Lid 0x3) ibping statistics ---
*3 packets transmitted, 3 received, 0% packet loss, time 2320 ms*
rtt min/avg/max = 0.069/0.089/0.111 ms
ibwarn: [5449] ibping: Ping..
*ibwarn: [5449] main: ibping to Lid 0x1 failed*
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] ibping: Ping..
ibwarn: [5449] main: ibping to Lid 0x1 failed
ibwarn: [5449] report: out due signal 2
--- (Lid 0x1) ibping statistics ---
*3 packets transmitted, 0 received, 100% packet loss, time 11358 ms*
rtt min/avg/max = 0.000/0.000/0.000 ms
Thanks,
Kapil
!DSPAM:46003995205571657414402!
---------------------------------------------------------------------
---
_______________________________________________
general mailing list
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/
openib-general
!DSPAM:46003995205571657414402!

--
Kyle Schochenmaier
Research Assistant, Dr. Brett Bode
AmesLab - US Dept.Energy
Scalable Computing Laboratory
_______________________________________________
general mailing list
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/
openib-general

--
Jeff Squyres
Cisco Systems