== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 15:54:00 (1746129240) start mds service on oleg205-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing load_modules_local oleg205-server: Loading modules from /home/green/git/lustre-release/lustre oleg205-server: detected 4 online CPUs by sysfs oleg205-server: MODOPTS_LIBCFS= oleg205-server: Force libcfs to create 2 CPU partitions oleg205-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg205-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg205-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg205-server: oleg205-server.virtnet: executing set_default_debug -1 all pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg205-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg205-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg205-server: oleg205-server.virtnet: executing set_default_debug -1 all pdsh@oleg205-client: oleg205-server: ssh exited with exit code 1 Started lustre-OST0000 oleg205-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg205-client.virtnet: -o user_xattr,flock 192.168.202.105@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 202 (time 1746129282.96 total 10.90 last 18.53) - open/close 452 (time 1746129293.00 total 20.94 last 24.90) - open/close 678 (time 1746129303.01 total 30.95 last 22.58) - open/close 875 (time 1746129313.59 total 41.53 last 18.63) - open/close 1131 (time 1746129324.50 total 52.44 last 23.45) - open/close 1342 (time 1746129334.60 total 62.54 last 20.89) - open/close 1536 (time 1746129345.11 total 73.06 last 18.46) - open/close 1681 (time 1746129355.32 total 83.26 last 14.21) - open/close 1922 (time 1746129365.47 total 93.41 last 23.74) - open/close 2154 (time 1746129376.37 total 104.31 last 21.29) - open/close 2384 (time 1746129387.37 total 115.31 last 20.91) - open/close 2537 (time 1746129399.22 total 127.17 last 12.91) - open/close 2750 (time 1746129409.54 total 137.48 last 20.65) - open/close 2985 (time 1746129419.88 total 147.82 last 22.73) - open/close 3145 (time 1746129430.84 total 158.79 last 14.59) - open/close 3420 (time 1746129441.65 total 169.60 last 25.44) - open/close 3694 (time 1746129452.35 total 180.29 last 25.63) - open/close 3904 (time 1746129465.17 total 193.11 last 16.38) - open/close 4147 (time 1746129475.83 total 203.77 last 22.79) - open/close 4410 (time 1746129486.12 total 214.06 last 25.57) - open/close 4637 (time 1746129496.90 total 224.84 last 21.05) - open/close 4905 (time 1746129507.63 total 235.58 last 24.97) - open/close 5222 (time 1746129518.65 total 246.60 last 28.77) - open/close 5426 (time 1746129528.67 total 256.61 last 20.37) - open/close 5679 (time 1746129538.67 total 266.61 last 25.30) - open/close 5980 (time 1746129549.15 total 277.10 last 28.71) - open/close 6244 (time 1746129559.82 total 287.76 last 24.76) - open/close 6476 (time 1746129570.26 total 298.20 last 22.23) - open/close 6678 (time 1746129580.59 total 308.53 last 19.54) - open/close 6938 (time 1746129591.31 total 319.25 last 24.25) - open/close 7205 (time 1746129601.64 total 329.58 last 25.85) - open/close 7446 (time 1746129612.50 total 340.44 last 22.20) - open/close 7633 (time 1746129623.40 total 351.34 last 17.15) - open/close 7802 (time 1746129633.63 total 361.57 last 16.52) - open/close 7994 (time 1746129644.17 total 372.11 last 18.22) - open/close 8216 (time 1746129654.19 total 382.13 last 22.15) - open/close 8396 (time 1746129664.88 total 392.82 last 16.84) - open/close 8554 (time 1746129675.18 total 403.12 last 15.35) - open/close 8712 (time 1746129687.62 total 415.56 last 12.70) - open/close 8899 (time 1746129698.23 total 426.18 last 17.62) - open/close 9925 (time 1746129708.24 total 436.18 last 102.54) - open/close 11515 (time 1746129718.24 total 446.18 last 158.95) - open/close 13271 (time 1746129728.25 total 456.19 last 175.52) - open/close 14867 (time 1746129738.25 total 466.19 last 159.53) - open/close 16409 (time 1746129748.26 total 476.20 last 154.10) - open/close 17635 (time 1746129758.26 total 486.20 last 122.56) - open/close 19210 (time 1746129768.27 total 496.21 last 157.41) - open/close 20000 (time 1746129773.39 total 501.33 last 154.14) - open/close 21307 (time 1746129783.40 total 511.34 last 130.64) - open/close 22726 (time 1746129793.40 total 521.34 last 141.81) - open/close 24010 (time 1746129803.40 total 531.35 last 128.36) - open/close 25231 (time 1746129813.41 total 541.35 last 122.08) - open/close 26547 (time 1746129823.41 total 551.35 last 131.52) - open/close 28172 (time 1746129833.42 total 561.36 last 162.39) - open/close 29721 (time 1746129843.42 total 571.37 last 154.83) - open/close 30903 (time 1746129853.42 total 581.37 last 118.19) - open/close 32475 (time 1746129863.43 total 591.37 last 157.18) - open/close 34228 (time 1746129873.43 total 601.37 last 175.27) - open/close 36032 (time 1746129883.43 total 611.37 last 180.34) - open/close 37890 (time 1746129893.44 total 621.38 last 185.71) - open/close 39855 (time 1746129903.44 total 631.38 last 196.49) - open/close 41381 (time 1746129913.44 total 641.38 last 152.53) - open/close 42897 (time 1746129923.44 total 651.39 last 151.56) - open/close 43975 (time 1746129933.44 total 661.39 last 107.79) - open/close 45126 (time 1746129943.45 total 671.39 last 115.04) - open/close 46723 (time 1746129953.46 total 681.40 last 159.62) - open/close 48250 (time 1746129963.46 total 691.40 last 152.65) - open/close 49600 (time 1746129973.46 total 701.40 last 134.94) total: 50000 open/close in 704.30 seconds: 70.99 ops/second - unlinked 0 (time 1746129977 ; total 0 ; last 0) - unlinked 10000 (time 1746130023 ; total 46 ; last 46) - unlinked 20000 (time 1746130063 ; total 86 ; last 40) - unlinked 30000 (time 1746130095 ; total 118 ; last 32) - unlinked 40000 (time 1746130129 ; total 152 ; last 34) total: 50000 unlinks in 196 seconds: 255.102036 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg205-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg205-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg205-server stop mds service on oleg205-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg205-server unloading modules via unload_modules_local on: 'oleg205-server' oleg205-server: oleg205-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg205-client: oleg205-client: ssh exited with exit code 2 pdsh@oleg205-client: oleg205-server: ssh exited with exit code 2 pdsh@oleg205-client: oleg205-client: ssh exited with exit code 2 pdsh@oleg205-client: oleg205-server: ssh exited with exit code 2