== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 13:46:47 (1718128007) start mds service on oleg404-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg404-server' oleg404-server: oleg404-server.virtnet: executing load_modules_local oleg404-server: Loading modules from /home/green/git/lustre-release/lustre oleg404-server: detected 4 online CPUs by sysfs oleg404-server: Force libcfs to create 2 CPU partitions oleg404-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg404-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg404-server: oleg404-server.virtnet: executing set_default_debug -1 all pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg404-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg404-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg404-server: oleg404-server.virtnet: executing set_default_debug -1 all pdsh@oleg404-client: oleg404-server: ssh exited with exit code 1 Started lustre-OST0000 oleg404-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg404-client.virtnet: -o user_xattr,flock oleg404-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 374 (time 1718128046.40 total 10.43 last 35.87) - open/close 939 (time 1718128056.60 total 20.63 last 55.38) - open/close 1475 (time 1718128067.60 total 31.63 last 48.74) - open/close 1885 (time 1718128078.22 total 42.25 last 38.59) - open/close 2250 (time 1718128088.45 total 52.48 last 35.67) - open/close 2839 (time 1718128098.72 total 62.75 last 57.40) - open/close 3277 (time 1718128109.46 total 73.49 last 40.75) - open/close 3759 (time 1718128120.35 total 84.38 last 44.25) - open/close 4403 (time 1718128130.72 total 94.75 last 62.15) - open/close 4929 (time 1718128140.72 total 104.75 last 52.59) - open/close 5443 (time 1718128150.76 total 114.79 last 51.18) - open/close 6007 (time 1718128161.03 total 125.06 last 54.94) - open/close 6512 (time 1718128171.03 total 135.06 last 50.49) - open/close 7108 (time 1718128181.43 total 145.46 last 57.32) - open/close 7756 (time 1718128191.97 total 156.00 last 61.45) - open/close 8248 (time 1718128203.99 total 168.02 last 40.92) - open/close 8740 (time 1718128213.99 total 178.02 last 49.20) - open/close 9223 (time 1718128225.92 total 189.95 last 40.49) - open/close 9818 (time 1718128236.26 total 200.29 last 57.57) - open/close 10000 (time 1718128238.97 total 203.00 last 67.19) - open/close 10547 (time 1718128249.05 total 213.08 last 54.23) - open/close 11120 (time 1718128259.35 total 223.38 last 55.67) - open/close 11675 (time 1718128269.58 total 233.61 last 54.25) - open/close 12289 (time 1718128280.00 total 244.03 last 58.91) - open/close 12722 (time 1718128290.64 total 254.67 last 40.71) - open/close 13242 (time 1718128301.43 total 265.46 last 48.19) - open/close 13809 (time 1718128313.57 total 277.60 last 46.70) - open/close 14413 (time 1718128323.93 total 287.96 last 58.30) - open/close 14974 (time 1718128334.16 total 298.19 last 54.85) - open/close 15421 (time 1718128344.78 total 308.81 last 42.09) - open/close 15943 (time 1718128354.78 total 318.81 last 52.20) - open/close 17708 (time 1718128364.78 total 328.81 last 176.46) - open/close 20000 (time 1718128373.11 total 337.14 last 275.27) - open/close 24114 (time 1718128383.11 total 347.14 last 411.29) - open/close 28326 (time 1718128393.11 total 357.14 last 421.18) - open/close 30000 (time 1718128399.76 total 363.79 last 251.53) - open/close 32600 (time 1718128409.76 total 373.79 last 259.99) - open/close 35140 (time 1718128419.77 total 383.80 last 253.96) - open/close 38067 (time 1718128429.77 total 393.80 last 292.60) - open/close 40000 (time 1718128437.53 total 401.56 last 249.06) - open/close 42493 (time 1718128447.53 total 411.56 last 249.25) - open/close 44961 (time 1718128457.53 total 421.56 last 246.78) - open/close 48572 (time 1718128467.53 total 431.56 last 361.07) total: 50000 open/close in 434.21 seconds: 115.15 ops/second - unlinked 0 (time 1718128471 ; total 0 ; last 0) - unlinked 10000 (time 1718128482 ; total 11 ; last 11) - unlinked 20000 (time 1718128494 ; total 23 ; last 12) - unlinked 30000 (time 1718128506 ; total 35 ; last 12) - unlinked 40000 (time 1718128517 ; total 46 ; last 11) total: 50000 unlinks in 58 seconds: 862.068970 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg404-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg404-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg404-server stop mds service on oleg404-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg404-server unloading modules on: 'oleg404-server' oleg404-server: oleg404-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg404-client: oleg404-client: ssh exited with exit code 2 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 2 pdsh@oleg404-client: oleg404-client: ssh exited with exit code 2 pdsh@oleg404-client: oleg404-server: ssh exited with exit code 2