== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 22:42:40 (1746067360) start mds service on oleg110-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg110-server' oleg110-server: oleg110-server.virtnet: executing load_modules_local oleg110-server: Loading modules from /home/green/git/lustre-release/lustre oleg110-server: detected 4 online CPUs by sysfs oleg110-server: MODOPTS_LIBCFS= oleg110-server: Force libcfs to create 2 CPU partitions oleg110-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg110-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg110-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg110-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg110-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg110-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 Started lustre-OST0000 oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg110-client.virtnet: -o user_xattr,flock 192.168.201.110@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 148 (time 1746067414.78 total 10.01 last 14.78) - open/close 335 (time 1746067425.16 total 20.39 last 18.02) - open/close 501 (time 1746067435.47 total 30.70 last 16.10) - open/close 654 (time 1746067446.17 total 41.40 last 14.30) - open/close 837 (time 1746067456.40 total 51.63 last 17.89) - open/close 985 (time 1746067466.41 total 61.64 last 14.79) - open/close 1139 (time 1746067476.94 total 72.17 last 14.62) - open/close 1209 (time 1746067489.89 total 85.12 last 5.40) - open/close 1374 (time 1746067499.89 total 95.12 last 16.50) - open/close 1579 (time 1746067509.90 total 105.13 last 20.50) - open/close 1816 (time 1746067520.20 total 115.43 last 23.00) - open/close 1975 (time 1746067531.02 total 126.25 last 14.69) - open/close 2203 (time 1746067541.15 total 136.38 last 22.50) - open/close 2512 (time 1746067551.99 total 147.22 last 28.51) - open/close 2753 (time 1746067562.24 total 157.47 last 23.53) - open/close 2850 (time 1746067572.78 total 168.01 last 9.20) - open/close 3013 (time 1746067583.73 total 178.96 last 14.89) - open/close 3173 (time 1746067594.07 total 189.30 last 15.48) - open/close 3289 (time 1746067604.78 total 200.01 last 10.82) - open/close 3436 (time 1746067615.56 total 210.79 last 13.64) - open/close 3568 (time 1746067626.56 total 221.79 last 12.01) - open/close 3715 (time 1746067636.56 total 231.79 last 14.69) - open/close 3864 (time 1746067646.56 total 241.79 last 14.90) - open/close 4012 (time 1746067656.74 total 251.97 last 14.54) - open/close 4162 (time 1746067667.66 total 262.89 last 13.73) - open/close 4252 (time 1746067677.81 total 273.04 last 8.87) - open/close 4522 (time 1746067688.17 total 283.40 last 26.07) - open/close 4810 (time 1746067698.94 total 294.18 last 26.73) - open/close 5023 (time 1746067709.11 total 304.34 last 20.96) - open/close 5228 (time 1746067719.31 total 314.54 last 20.09) - open/close 5419 (time 1746067732.27 total 327.50 last 14.74) - open/close 5579 (time 1746067742.27 total 337.50 last 15.99) - open/close 5751 (time 1746067753.95 total 349.18 last 14.72) - open/close 5975 (time 1746067764.11 total 359.34 last 22.07) - open/close 6080 (time 1746067774.39 total 369.62 last 10.21) - open/close 6318 (time 1746067784.77 total 380.00 last 22.92) - open/close 6489 (time 1746067795.52 total 390.75 last 15.90) - open/close 6669 (time 1746067805.53 total 400.76 last 17.99) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-6803) error: No space left on device total: 6803 open/close in 406.14 seconds: 16.75 ops/second /home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8972: kill: (9007) - No such process - unlinked 0 (time 1746067813 ; total 0 ; last 0) unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-6803) error: No such file or directory total: 6803 unlinks in 34 seconds: 200.088242 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg110-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg110-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg110-server stop mds service on oleg110-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg110-server unloading modules via unload_modules_local on: 'oleg110-server' oleg110-server: oleg110-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg110-client: oleg110-client: ssh exited with exit code 2 pdsh@oleg110-client: oleg110-server: ssh exited with exit code 2 pdsh@oleg110-client: oleg110-client: ssh exited with exit code 2 pdsh@oleg110-client: oleg110-server: ssh exited with exit code 2