== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 13:46:22 (1743529582) start mds service on oleg116-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg116-server' oleg116-server: oleg116-server.virtnet: executing load_modules_local oleg116-server: Loading modules from /home/green/git/lustre-release/lustre oleg116-server: detected 4 online CPUs by sysfs oleg116-server: Force libcfs to create 2 CPU partitions oleg116-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg116-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg116-server: oleg116-server.virtnet: executing set_default_debug -1 all pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg116-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg116-server: oleg116-server.virtnet: executing set_default_debug -1 all pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg116-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg116-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg116-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg116-server: oleg116-server.virtnet: executing set_default_debug -1 all pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Started lustre-OST0000 oleg116-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg116-client.virtnet: -o user_xattr,flock oleg116-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 899 (time 1743529621.17 total 10.70 last 84.04) - open/close 1665 (time 1743529631.54 total 21.07 last 73.82) - open/close 2275 (time 1743529641.65 total 31.17 last 60.39) - open/close 3013 (time 1743529652.01 total 41.54 last 71.19) - open/close 3751 (time 1743529662.38 total 51.91 last 71.18) - open/close 4529 (time 1743529672.82 total 62.34 last 74.55) - open/close 5119 (time 1743529682.91 total 72.44 last 58.46) - open/close 5705 (time 1743529693.03 total 82.56 last 57.90) - open/close 6486 (time 1743529703.47 total 92.99 last 74.82) - open/close 7195 (time 1743529713.80 total 103.33 last 68.59) - open/close 7915 (time 1743529724.15 total 113.68 last 69.60) - open/close 8553 (time 1743529734.35 total 123.88 last 62.52) - open/close 9249 (time 1743529744.64 total 134.17 last 67.65) - open/close 9911 (time 1743529754.84 total 144.37 last 64.88) - open/close 10580 (time 1743529765.06 total 154.59 last 65.47) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-10833) error: No space left on device total: 10833 open/close in 157.06 seconds: 68.97 ops/second /home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8274: kill: (11206) - No such process - unlinked 0 (time 1743529769 ; total 0 ; last 0) - unlinked 10000 (time 1743529778 ; total 9 ; last 9) unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-10833) error: No such file or directory total: 10833 unlinks in 10 seconds: 1083.300049 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg116-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg116-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg116-server stop mds service on oleg116-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg116-server stop mds service on oleg116-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg116-server unloading modules on: 'oleg116-server' oleg116-server: oleg116-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg116-client: oleg116-client: ssh exited with exit code 2 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 2 pdsh@oleg116-client: oleg116-client: ssh exited with exit code 2 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 2