== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 06:05:36 (1744884336) start mds service on oleg204-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg204-server' oleg204-server: oleg204-server.virtnet: executing load_modules_local oleg204-server: Loading modules from /home/green/git/lustre-release/lustre oleg204-server: detected 4 online CPUs by sysfs oleg204-server: MODOPTS_LIBCFS= oleg204-server: Force libcfs to create 2 CPU partitions oleg204-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg204-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg204-server: oleg204-server.virtnet: executing set_default_debug -1 all pdsh@oleg204-client: oleg204-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg204-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg204-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg204-server: oleg204-server.virtnet: executing set_default_debug -1 all pdsh@oleg204-client: oleg204-server: ssh exited with exit code 1 Started lustre-OST0000 oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg204-client.virtnet: -o user_xattr,flock 192.168.202.104@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 265 (time 1744884375.22 total 10.52 last 25.18) - open/close 588 (time 1744884385.84 total 21.14 last 30.43) - open/close 988 (time 1744884396.03 total 31.33 last 39.25) - open/close 1311 (time 1744884406.67 total 41.97 last 30.34) - open/close 1672 (time 1744884417.39 total 52.69 last 33.68) - open/close 2053 (time 1744884428.22 total 63.52 last 35.20) - open/close 2420 (time 1744884440.06 total 75.36 last 30.98) - open/close 2699 (time 1744884451.06 total 86.36 last 25.38) - open/close 2897 (time 1744884461.79 total 97.09 last 18.45) - open/close 3280 (time 1744884472.41 total 107.71 last 36.05) - open/close 3572 (time 1744884482.56 total 117.86 last 28.78) - open/close 3848 (time 1744884493.54 total 128.84 last 25.13) - open/close 4070 (time 1744884506.24 total 141.54 last 17.49) - open/close 4434 (time 1744884516.30 total 151.60 last 36.19) - open/close 4736 (time 1744884526.63 total 161.93 last 29.23) - open/close 4992 (time 1744884536.63 total 171.93 last 25.60) - open/close 5088 (time 1744884546.93 total 182.23 last 9.32) - open/close 5504 (time 1744884556.93 total 192.23 last 41.59) - open/close 5843 (time 1744884567.93 total 203.23 last 30.82) - open/close 6315 (time 1744884577.93 total 213.23 last 47.20) - open/close 6979 (time 1744884588.19 total 223.49 last 64.68) - open/close 7743 (time 1744884598.93 total 234.23 last 71.12) - open/close 8259 (time 1744884609.21 total 244.51 last 50.22) - open/close 8993 (time 1744884619.93 total 255.23 last 68.46) - open/close 9425 (time 1744884629.93 total 265.23 last 43.20) - open/close 10000 (time 1744884636.17 total 271.47 last 92.11) - open/close 13859 (time 1744884646.18 total 281.48 last 385.81) - open/close 17388 (time 1744884656.18 total 291.48 last 352.86) - open/close 20000 (time 1744884662.94 total 298.24 last 386.13) - open/close 23452 (time 1744884672.94 total 308.24 last 345.16) - open/close 27271 (time 1744884682.94 total 318.24 last 381.86) - open/close 30000 (time 1744884690.92 total 326.22 last 342.18) - open/close 33121 (time 1744884700.92 total 336.22 last 312.09) - open/close 35714 (time 1744884710.92 total 346.22 last 259.23) - open/close 38747 (time 1744884720.92 total 356.22 last 303.27) - open/close 40000 (time 1744884724.92 total 360.22 last 313.89) - open/close 43034 (time 1744884734.97 total 370.27 last 301.70) - open/close 46028 (time 1744884744.97 total 380.27 last 299.37) - open/close 49458 (time 1744884754.97 total 390.27 last 342.98) total: 50000 open/close in 391.83 seconds: 127.61 ops/second - unlinked 0 (time 1744884757 ; total 0 ; last 0) - unlinked 10000 (time 1744884770 ; total 13 ; last 13) - unlinked 20000 (time 1744884781 ; total 24 ; last 11) - unlinked 30000 (time 1744884794 ; total 37 ; last 13) - unlinked 40000 (time 1744884808 ; total 51 ; last 14) total: 50000 unlinks in 65 seconds: 769.230774 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg204-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg204-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg204-server stop mds service on oleg204-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg204-server unloading modules via unload_modules_local on: 'oleg204-server' oleg204-server: oleg204-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg204-client: oleg204-client: ssh exited with exit code 2 pdsh@oleg204-client: oleg204-server: ssh exited with exit code 2 pdsh@oleg204-client: oleg204-client: ssh exited with exit code 2 pdsh@oleg204-client: oleg204-server: ssh exited with exit code 2