== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 22:12:51 (1746151971) start mds service on oleg404-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg404-server' oleg404-server: oleg404-server.virtnet: executing load_modules_local oleg404-server: Loading modules from /home/green/git/lustre-release/lustre oleg404-server: detected 4 online CPUs by sysfs oleg404-server: MODOPTS_LIBCFS= oleg404-server: Force libcfs to create 2 CPU partitions oleg404-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg404-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg404-server: oleg404-server.virtnet: executing set_default_debug -1 all pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg404-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg404-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg404-server: oleg404-server.virtnet: executing set_default_debug -1 all pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-OST0000 oleg404-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg404-client.virtnet: -o user_xattr,flock 192.168.204.104@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 303 (time 1746152010.41 total 10.78 last 28.11) - open/close 624 (time 1746152020.65 total 21.02 last 31.34) - open/close 905 (time 1746152030.65 total 31.02 last 28.09) - open/close 1215 (time 1746152041.02 total 41.39 last 29.89) - open/close 1408 (time 1746152051.18 total 51.55 last 19.01) - open/close 1760 (time 1746152061.86 total 62.23 last 32.95) - open/close 2049 (time 1746152072.68 total 73.05 last 26.72) - open/close 2418 (time 1746152082.68 total 83.05 last 36.89) - open/close 2758 (time 1746152093.31 total 93.68 last 31.99) - open/close 3161 (time 1746152106.29 total 106.66 last 31.04) - open/close 3395 (time 1746152117.58 total 117.95 last 20.72) - open/close 3656 (time 1746152128.08 total 128.45 last 24.87) - open/close 3912 (time 1746152138.50 total 138.87 last 24.55) - open/close 4261 (time 1746152149.38 total 149.75 last 32.10) - open/close 4490 (time 1746152159.71 total 160.08 last 22.16) - open/close 4745 (time 1746152170.71 total 171.08 last 23.18) - open/close 5046 (time 1746152181.24 total 181.61 last 28.58) - open/close 5393 (time 1746152191.97 total 192.34 last 32.35) - open/close 5585 (time 1746152202.29 total 202.67 last 18.60) - open/close 5804 (time 1746152212.83 total 213.20 last 20.79) - open/close 5930 (time 1746152222.85 total 223.22 last 12.57) - open/close 6268 (time 1746152233.71 total 234.08 last 31.13) - open/close 6608 (time 1746152244.43 total 244.80 last 31.73) - open/close 6934 (time 1746152254.96 total 255.33 last 30.94) - open/close 7178 (time 1746152265.89 total 266.26 last 22.33) - open/close 7353 (time 1746152276.68 total 277.05 last 16.22) - open/close 7567 (time 1746152286.68 total 287.05 last 21.40) - open/close 7757 (time 1746152297.25 total 297.62 last 17.98) - open/close 8096 (time 1746152307.70 total 308.07 last 32.45) - open/close 8384 (time 1746152318.17 total 318.54 last 27.51) - open/close 9683 (time 1746152328.17 total 328.54 last 129.88) - open/close 12264 (time 1746152338.17 total 338.54 last 258.08) - open/close 14242 (time 1746152348.18 total 348.55 last 197.67) - open/close 16319 (time 1746152358.18 total 358.55 last 207.67) - open/close 18273 (time 1746152368.18 total 368.55 last 195.32) - open/close 19610 (time 1746152378.19 total 378.56 last 133.61) - open/close 21865 (time 1746152388.19 total 388.56 last 225.44) - open/close 23434 (time 1746152398.20 total 398.57 last 156.84) - open/close 24820 (time 1746152408.20 total 408.57 last 138.53) - open/close 26556 (time 1746152418.20 total 418.57 last 173.55) - open/close 28282 (time 1746152428.21 total 428.58 last 172.42) - open/close 30000 (time 1746152435.88 total 436.26 last 223.95) - open/close 31702 (time 1746152445.89 total 446.26 last 170.17) - open/close 33450 (time 1746152455.89 total 456.26 last 174.77) - open/close 35392 (time 1746152465.89 total 466.26 last 194.16) - open/close 37238 (time 1746152475.89 total 476.26 last 184.60) - open/close 39108 (time 1746152485.89 total 486.26 last 186.99) - open/close 40000 (time 1746152491.75 total 492.12 last 152.21) - open/close 41740 (time 1746152501.75 total 502.12 last 173.99) - open/close 43483 (time 1746152511.75 total 512.12 last 174.25) - open/close 45373 (time 1746152521.76 total 522.13 last 188.90) - open/close 46863 (time 1746152531.76 total 532.13 last 148.96) - open/close 48482 (time 1746152541.77 total 542.14 last 161.82) - open/close 49996 (time 1746152551.77 total 552.14 last 151.36) total: 50000 open/close in 552.15 seconds: 90.55 ops/second - unlinked 0 (time 1746152553 ; total 0 ; last 0) - unlinked 10000 (time 1746152591 ; total 38 ; last 38) - unlinked 20000 (time 1746152630 ; total 77 ; last 39) - unlinked 30000 (time 1746152658 ; total 105 ; last 28) - unlinked 40000 (time 1746152694 ; total 141 ; last 36) total: 50000 unlinks in 185 seconds: 270.270264 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg404-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg404-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg404-server stop mds service on oleg404-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg404-server unloading modules via unload_modules_local on: 'oleg404-server' oleg404-server: oleg404-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg404-client: oleg404-client: ssh exited with exit code 2 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 2 pdsh@oleg404-client: oleg404-client: ssh exited with exit code 2 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 2