Redhat ルーティング InfiniBand の問題

Redhat ルーティング InfiniBand の問題

システム(HPC)があります。

  • ヘッドノード1個(192.168.2.2)

  • 10ノードと(192.168.245-254)

  • NFSサーバー1台(192.168.2.244)。

私のヘッドノードはNFSサーバーにpingできませんが、NFSサーバーからヘッドノードにpingできます。

2台のPCでファイアウォールを無効にしましたが、まだ機能しません。

ヘッドノード ルート-n(192.168.2.2)

[root@cluster ~]# route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
172.16.39.0     0.0.0.0         255.255.255.0   U     0      0        0 vmnet1
192.168.2.0     0.0.0.0         255.255.255.0   U     0      0        0 ib0
192.168.2.0     0.0.0.0         255.255.255.0   U     0      0        0 em1
172.16.112.0    0.0.0.0         255.255.255.0   U     0      0        0 vmnet8
10.10.41.0      0.0.0.0         255.255.255.0   U     0      0        0 em2
192.168.122.0   0.0.0.0         255.255.255.0   U     0      0        0 virbr0
10.10.10.0      0.0.0.0         255.255.254.0   U     0      0        0 pem3
169.254.0.0     0.0.0.0         255.255.0.0     U     1006   0        0 ib0
169.254.0.0     0.0.0.0         255.255.0.0     U     1030   0        0 em1
0.0.0.0         10.10.10.1      0.0.0.0         UG    0      0        0 pem3

arp-a

[root@cluster ~]# arp -a
compute-0-5.local (192.168.2.249) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (10.10.41.1) at <incomplete> on em2
compute-0-0.local (192.168.2.254) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
compute-0-3.local (192.168.2.251) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
compute-0-4.local (192.168.2.250) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
compute-0-7.local (192.168.2.247) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (10.10.10.218) at f8:28:19:1f:22:33 [ether] on pem3
? (10.10.11.17) at 88:e9:fe:70:25:26 [ether] on pem3
compute-0-6.local (192.168.2.248) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
compute-0-1.local (192.168.2.253) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (10.10.10.47) at c0:cb:38:3e:72:6d [ether] on pem3
? (10.10.10.1) at 1c:df:0f:b7:11:3f [ether] on pem3
compute-0-2.local (192.168.2.252) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
rockscluster-nfs (192.168.2.244) at <incomplete> on ib0

IP 192.168.2.244に接続できません。

NFSサーバー

パス-n

[root@rockscluster-nfs ~]# route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         10.10.40.1      0.0.0.0         UG    100    0        0 em1
10.10.40.1      0.0.0.0         255.255.255.255 UH    100    0        0 em1
10.10.41.0      0.0.0.0         255.255.255.0   U     100    0        0 em1
192.168.2.0     0.0.0.0         255.255.255.0   U     150    0        0 ib0
192.168.122.0   0.0.0.0         255.255.255.0   U     0      0        0 virbr0

arp-a

[root@rockscluster-nfs ~]# arp -a
? (192.168.2.250) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
gateway (10.10.40.1) at <incomplete> on em1
? (192.168.2.253) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (192.168.2.248) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (10.10.41.149) at <incomplete> on em1
? (192.168.2.251) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (10.10.41.223) at a0:48:1c:df:f8:86 [ether] on em1
? (10.10.41.119) at 80:18:44:e6:48:9d [ether] on em1
? (10.10.41.1) at <incomplete> on em1
? (192.168.2.254) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (10.10.11.209) at d8:9e:f3:18:39:26 [ether] on em1
? (192.168.2.249) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (192.168.2.252) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (192.168.2.247) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0
? (192.168.2.2) at 48:00:00:80:fe:80:00:00:00 [infiniband] on ib0

関連情報