== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 11:16:21 (1755098181) start mds service on oleg333-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg333-server' oleg333-server: oleg333-server.virtnet: executing load_modules_local oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg333-server: Loading modules from /home/green/git/lustre-release/lustre oleg333-server: detected 4 online CPUs by sysfs oleg333-server: MODOPTS_LIBCFS= oleg333-server: Force libcfs to create 2 CPU partitions oleg333-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg333-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg333-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg333-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Started lustre-OST0000 oleg333-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg333-client.virtnet: -o user_xattr,flock 192.168.203.133@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 782 (time 1755098238.31 total 10.01 last 78.11) - open/close 1583 (time 1755098248.43 total 20.12 last 79.21) - open/close 2352 (time 1755098259.37 total 31.07 last 70.25) - open/close 3048 (time 1755098270.25 total 41.95 last 63.98) - open/close 3746 (time 1755098281.07 total 52.77 last 64.52) - open/close 4544 (time 1755098291.07 total 62.77 last 79.79) - open/close 5210 (time 1755098301.87 total 73.57 last 61.67) - open/close 5969 (time 1755098312.88 total 84.57 last 68.95) - open/close 6764 (time 1755098322.88 total 94.58 last 79.49) - open/close 7399 (time 1755098333.68 total 105.37 last 58.81) - open/close 8199 (time 1755098343.79 total 115.48 last 79.12) - open/close 8874 (time 1755098354.67 total 126.37 last 62.01) - open/close 9536 (time 1755098365.48 total 137.18 last 61.23) - open/close 10000 (time 1755098370.74 total 142.44 last 88.25) - open/close 10785 (time 1755098381.80 total 153.50 last 70.95) - open/close 11453 (time 1755098392.55 total 164.25 last 62.14) - open/close 12198 (time 1755098403.57 total 175.26 last 67.66) - open/close 12967 (time 1755098413.57 total 185.26 last 76.90) - open/close 13761 (time 1755098424.62 total 196.32 last 71.81) - open/close 14518 (time 1755098434.62 total 206.32 last 75.69) - open/close 15147 (time 1755098445.36 total 217.06 last 58.60) - open/close 15669 (time 1755098455.91 total 227.61 last 49.45) - open/close 16271 (time 1755098466.61 total 238.30 last 56.30) - open/close 16879 (time 1755098477.23 total 248.92 last 57.25) - open/close 17553 (time 1755098488.11 total 259.80 last 61.95) - open/close 18137 (time 1755098498.67 total 270.37 last 55.29) - open/close 18785 (time 1755098509.48 total 281.18 last 59.92) - open/close 19390 (time 1755098520.24 total 291.94 last 56.25) - open/close 20000 (time 1755098529.82 total 301.52 last 63.67) - open/close 23856 (time 1755098539.82 total 311.52 last 385.60) - open/close 28747 (time 1755098549.82 total 321.52 last 489.10) - open/close 30000 (time 1755098552.38 total 324.08 last 488.66) - open/close 34830 (time 1755098562.38 total 334.08 last 482.96) - open/close 39650 (time 1755098572.39 total 344.08 last 481.91) - open/close 44421 (time 1755098582.39 total 354.09 last 477.01) - open/close 49134 (time 1755098592.39 total 364.09 last 471.28) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-49632) error: No space left on device total: 49632 open/close in 365.17 seconds: 135.92 ops/second