-----============= acceptance-small: conf-sanity ============----- Tue Jun 2 02:11:20 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg440-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg440-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg440-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg440-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg440-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg440-server oleg440-server: oleg440-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg440-server' oleg440-server: oleg440-server.virtnet: executing load_modules_local oleg440-server: Loading modules from /home/green/git/lustre-release/lustre oleg440-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg440-server: detected 4 online CPUs by sysfs oleg440-server: MODOPTS_LIBCFS= oleg440-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg440-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg440-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg440-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg440-server: oleg440-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg440-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg440-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server stop mds service on oleg440-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg440-server == conf-sanity test 45: long unlink handling in ptlrpcd == 02:14:20 (1780380860) start mds service on oleg440-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg440-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg440-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-OST0000 oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg440-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg440-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg440-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg440-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg440-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg440-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server stop mds service on oleg440-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg440-server unloading modules via unload_modules_local on: 'oleg440-server' oleg440-server: oleg440-server.virtnet: executing unload_modules_local oleg440-server: modules unloaded. pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 pdsh@oleg440-client: oleg440-client: ssh exited with exit code 2 pdsh@oleg440-client: oleg440-client: ssh exited with exit code 2 pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 PASS 45 (211s) == conf-sanity test 69: replace an OST with the same index ========================================================== 02:17:51 (1780381071) start mds service on oleg440-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg440-server' oleg440-server: oleg440-server.virtnet: executing load_modules_local oleg440-server: Loading modules from /home/green/git/lustre-release/lustre oleg440-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg440-server: detected 4 online CPUs by sysfs oleg440-server: MODOPTS_LIBCFS= oleg440-server: Force libcfs to create 2 CPU partitions oleg440-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg440-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg440-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg440-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg440-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-OST0000 oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11904 inodes available. Want 99872. rc=0 - open/close 581 (time 1780381155.91 total 10.01 last 58.04) - open/close 1193 (time 1780381165.92 total 20.02 last 61.15) - open/close 1796 (time 1780381175.93 total 30.03 last 60.21) - open/close 2406 (time 1780381185.95 total 40.06 last 60.87) - open/close 2881 (time 1780381195.96 total 50.07 last 47.45) - open/close 3511 (time 1780381205.98 total 60.08 last 62.90) - open/close 4115 (time 1780381215.99 total 70.09 last 60.34) - open/close 4670 (time 1780381226.00 total 80.10 last 55.46) - open/close 5304 (time 1780381236.00 total 90.11 last 63.36) - open/close 5873 (time 1780381246.01 total 100.12 last 56.85) - open/close 6494 (time 1780381256.02 total 110.13 last 62.02) - open/close 7131 (time 1780381266.04 total 120.14 last 63.62) - open/close 7804 (time 1780381276.05 total 130.15 last 67.23) - open/close 8418 (time 1780381286.06 total 140.16 last 61.35) - open/close 9080 (time 1780381296.07 total 150.17 last 66.11) - open/close 9585 (time 1780381306.08 total 160.18 last 50.46) total: 10000 open/close in 167.71 seconds: 59.63 ops/second - unlinked 0 (time 1780381318 ; total 0 ; last 0) total: 10000 unlinks in 113 seconds: 88.495575 unlinks/second - open/close 619 (time 1780381446.14 total 10.02 last 61.76) - open/close 1204 (time 1780381456.16 total 20.05 last 58.36) - open/close 1821 (time 1780381466.18 total 30.07 last 61.58) - open/close 2442 (time 1780381476.19 total 40.08 last 62.03) - open/close 3083 (time 1780381486.20 total 50.08 last 64.07) - open/close 3679 (time 1780381496.20 total 60.08 last 59.58) - open/close 4226 (time 1780381506.22 total 70.11 last 54.56) - open/close 4819 (time 1780381516.24 total 80.12 last 59.22) - open/close 5423 (time 1780381526.25 total 90.13 last 60.35) - open/close 6077 (time 1780381536.26 total 100.15 last 65.30) - open/close 6666 (time 1780381546.28 total 110.16 last 58.82) - open/close 7258 (time 1780381556.28 total 120.17 last 59.17) - open/close 7825 (time 1780381566.29 total 130.18 last 56.63) - open/close 8490 (time 1780381576.31 total 140.19 last 66.41) - open/close 9089 (time 1780381586.32 total 150.21 last 59.82) - open/close 9673 (time 1780381596.32 total 160.21 last 58.37) total: 10000 open/close in 165.77 seconds: 60.33 ops/second - unlinked 0 (time 1780381606 ; total 0 ; last 0) total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second - open/close 512 (time 1780381726.62 total 10.02 last 51.12) - open/close 1104 (time 1780381736.62 total 20.02 last 59.15) - open/close 1733 (time 1780381746.63 total 30.03 last 62.84) - open/close 2331 (time 1780381756.64 total 40.04 last 59.74) - open/close 2908 (time 1780381766.68 total 50.08 last 57.50) - open/close 3329 (time 1780381776.68 total 60.08 last 42.08) - open/close 3805 (time 1780381786.68 total 70.09 last 47.59) - open/close 4331 (time 1780381796.72 total 80.12 last 52.41) - open/close 4872 (time 1780381806.73 total 90.13 last 54.08) - open/close 5437 (time 1780381816.73 total 100.13 last 56.49) - open/close 6020 (time 1780381826.74 total 110.14 last 58.22) - open/close 6629 (time 1780381836.75 total 120.15 last 60.87) - open/close 7216 (time 1780381846.75 total 130.15 last 58.65) - open/close 7739 (time 1780381856.77 total 140.17 last 52.22) - open/close 8260 (time 1780381866.78 total 150.18 last 52.06) - open/close 8852 (time 1780381876.79 total 160.19 last 59.12) - open/close 9451 (time 1780381886.79 total 170.19 last 59.88) total: 10000 open/close in 179.35 seconds: 55.76 ops/second - unlinked 0 (time 1780381902 ; total 0 ; last 0) total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second - open/close 633 (time 1780382025.14 total 10.00 last 63.29) - open/close 1228 (time 1780382035.16 total 20.03 last 59.35) - open/close 1817 (time 1780382045.17 total 30.04 last 58.84) - open/close 2385 (time 1780382055.20 total 40.07 last 56.63) - open/close 3008 (time 1780382065.23 total 50.09 last 62.14) - open/close 3544 (time 1780382075.24 total 60.10 last 53.55) - open/close 4150 (time 1780382085.26 total 70.12 last 60.47) - open/close 4699 (time 1780382095.29 total 80.15 last 54.73) - open/close 5172 (time 1780382105.29 total 90.16 last 47.28) - open/close 5692 (time 1780382115.30 total 100.16 last 51.97) - open/close 6320 (time 1780382125.31 total 110.17 last 62.74) - open/close 6905 (time 1780382135.33 total 120.20 last 58.37) - open/close 7391 (time 1780382145.35 total 130.21 last 48.51) - open/close 7821 (time 1780382155.35 total 140.21 last 42.99) - open/close 8333 (time 1780382165.36 total 150.22 last 51.15) - open/close 8877 (time 1780382175.37 total 160.23 last 54.37) - open/close 9474 (time 1780382185.38 total 170.25 last 59.61) total: 10000 open/close in 178.78 seconds: 55.93 ops/second - unlinked 0 (time 1780382198 ; total 0 ; last 0) total: 10000 unlinks in 117 seconds: 85.470085 unlinks/second - open/close 455 (time 1780382331.87 total 10.01 last 45.47) - open/close 952 (time 1780382341.89 total 20.02 last 49.61) - open/close 1502 (time 1780382351.89 total 30.03 last 54.95) - open/close 2097 (time 1780382361.90 total 40.04 last 59.43) - open/close 2699 (time 1780382371.91 total 50.05 last 60.14) - open/close 3308 (time 1780382381.92 total 60.06 last 60.88) - open/close 3900 (time 1780382391.94 total 70.08 last 59.05) - open/close 4446 (time 1780382401.95 total 80.09 last 54.57) - open/close 4980 (time 1780382411.95 total 90.09 last 53.40) - open/close 5516 (time 1780382421.98 total 100.11 last 53.46) - open/close 6082 (time 1780382431.98 total 110.12 last 56.59) - open/close 6604 (time 1780382441.99 total 120.12 last 52.16) - open/close 7170 (time 1780382452.03 total 130.17 last 56.33) - open/close 7762 (time 1780382462.04 total 140.17 last 59.19) - open/close 8328 (time 1780382472.04 total 150.18 last 56.58) - open/close 8906 (time 1780382482.05 total 160.19 last 57.72) - open/close 9519 (time 1780382492.05 total 170.19 last 61.29) total: 10000 open/close in 178.65 seconds: 55.97 ops/second - unlinked 0 (time 1780382505 ; total 0 ; last 0) total: 10000 unlinks in 123 seconds: 81.300812 unlinks/second - open/close 462 (time 1780382644.98 total 10.00 last 46.20) - open/close 1005 (time 1780382654.98 total 20.01 last 54.27) - open/close 1542 (time 1780382664.99 total 30.01 last 53.66) - open/close 2055 (time 1780382675.00 total 40.02 last 51.25) - open/close 2552 (time 1780382685.02 total 50.05 last 49.59) - open/close 2972 (time 1780382695.04 total 60.06 last 41.95) - open/close 3485 (time 1780382705.04 total 70.06 last 51.29) - open/close 3926 (time 1780382715.05 total 80.08 last 44.02) - open/close 4493 (time 1780382725.09 total 90.11 last 56.53) - open/close 5028 (time 1780382735.10 total 100.12 last 53.44) - open/close 5576 (time 1780382745.11 total 110.13 last 54.72) - open/close 6063 (time 1780382755.14 total 120.16 last 48.57) - open/close 6510 (time 1780382765.14 total 130.16 last 44.68) - open/close 6958 (time 1780382775.15 total 140.17 last 44.77) - open/close 7493 (time 1780382785.16 total 150.18 last 53.45) - open/close 8107 (time 1780382795.17 total 160.19 last 61.36) - open/close 8692 (time 1780382805.18 total 170.20 last 58.42) - open/close 9229 (time 1780382815.19 total 180.22 last 53.62) - open/close 9706 (time 1780382825.24 total 190.26 last 47.48) total: 10000 open/close in 195.51 seconds: 51.15 ops/second - unlinked 0 (time 1780382835 ; total 0 ; last 0) total: 10000 unlinks in 108 seconds: 92.592590 unlinks/second - open/close 540 (time 1780382957.76 total 10.01 last 53.96) - open/close 1136 (time 1780382967.76 total 20.01 last 59.59) - open/close 1748 (time 1780382977.77 total 30.01 last 61.18) - open/close 2373 (time 1780382987.78 total 40.02 last 62.45) - open/close 2976 (time 1780382997.79 total 50.03 last 60.24) - open/close 3559 (time 1780383007.79 total 60.04 last 58.27) - open/close 4100 (time 1780383017.81 total 70.05 last 54.01) - open/close 4647 (time 1780383027.82 total 80.07 last 54.64) - open/close 5102 (time 1780383037.83 total 90.08 last 45.45) - open/close 5485 (time 1780383047.85 total 100.09 last 38.24) - open/close 5948 (time 1780383057.87 total 110.11 last 46.20) - open/close 6496 (time 1780383067.88 total 120.12 last 54.76) - open/close 7011 (time 1780383077.90 total 130.15 last 51.36) - open/close 7560 (time 1780383087.92 total 140.16 last 54.84) - open/close 8125 (time 1780383097.93 total 150.17 last 56.44) - open/close 8656 (time 1780383107.95 total 160.20 last 52.97) - open/close 9140 (time 1780383117.96 total 170.20 last 48.37) - open/close 9675 (time 1780383127.96 total 180.21 last 53.47) total: 10000 open/close in 185.91 seconds: 53.79 ops/second - unlinked 0 (time 1780383138 ; total 0 ; last 0) total: 10000 unlinks in 107 seconds: 93.457947 unlinks/second - open/close 461 (time 1780383261.68 total 10.00 last 46.09) - open/close 937 (time 1780383271.69 total 20.01 last 47.57) - open/close 1379 (time 1780383281.70 total 30.02 last 44.16) - open/close 1884 (time 1780383291.72 total 40.04 last 50.38) - open/close 2338 (time 1780383301.73 total 50.05 last 45.34) - open/close 2742 (time 1780383311.75 total 60.07 last 40.33) - open/close 3177 (time 1780383321.75 total 70.07 last 43.50) - open/close 3685 (time 1780383331.75 total 80.07 last 50.79) - open/close 4241 (time 1780383341.76 total 90.08 last 55.57) - open/close 4780 (time 1780383351.77 total 100.09 last 53.86) - open/close 5296 (time 1780383361.77 total 110.09 last 51.59) - open/close 5762 (time 1780383371.77 total 120.09 last 46.60) - open/close 6235 (time 1780383381.78 total 130.10 last 47.27) - open/close 6775 (time 1780383391.79 total 140.11 last 53.94) - open/close 7332 (time 1780383401.80 total 150.12 last 55.65) - open/close 7862 (time 1780383411.82 total 160.14 last 52.88) - open/close 8343 (time 1780383421.83 total 170.15 last 48.06) - open/close 8908 (time 1780383431.83 total 180.15 last 56.47) - open/close 9408 (time 1780383441.85 total 190.17 last 49.92) - open/close 9916 (time 1780383451.88 total 200.20 last 50.65) total: 10000 open/close in 202.17 seconds: 49.46 ops/second - unlinked 0 (time 1780383459 ; total 0 ; last 0) total: 10000 unlinks in 118 seconds: 84.745766 unlinks/second - open/close 606 (time 1780383592.28 total 10.01 last 60.57) - open/close 1196 (time 1780383602.28 total 20.01 last 58.95) - open/close 1783 (time 1780383612.30 total 30.03 last 58.62) - open/close 2396 (time 1780383622.30 total 40.03 last 61.27) - open/close 2950 (time 1780383632.32 total 50.05 last 55.29) - open/close 3438 (time 1780383642.35 total 60.08 last 48.67) - open/close 3964 (time 1780383652.36 total 70.09 last 52.53) - open/close 4376 (time 1780383662.42 total 80.15 last 40.99) - open/close 4847 (time 1780383672.42 total 90.15 last 47.09) - open/close 5376 (time 1780383682.42 total 100.15 last 52.90) - open/close 5911 (time 1780383692.42 total 110.15 last 53.49) - open/close 6458 (time 1780383702.43 total 120.16 last 54.67) - open/close 6901 (time 1780383712.43 total 130.16 last 44.29) - open/close 7301 (time 1780383722.43 total 140.16 last 39.99) - open/close 7842 (time 1780383732.45 total 150.18 last 53.99) - open/close 8379 (time 1780383742.46 total 160.19 last 53.67) - open/close 8920 (time 1780383752.47 total 170.20 last 54.04) - open/close 9398 (time 1780383762.48 total 180.21 last 47.74) - open/close 9767 (time 1780383772.51 total 190.24 last 36.79) total: 10000 open/close in 197.37 seconds: 50.67 ops/second - unlinked 0 (time 1780383785 ; total 0 ; last 0) total: 10000 unlinks in 113 seconds: 88.495575 unlinks/second - open/close 340 (time 1780383915.75 total 10.01 last 33.98) - open/close 741 (time 1780383925.77 total 20.02 last 40.03) - open/close 1345 (time 1780383935.77 total 30.03 last 60.38) - open/close 1937 (time 1780383945.78 total 40.03 last 59.17) - open/close 2431 (time 1780383955.80 total 50.05 last 49.31) - open/close 2936 (time 1780383965.81 total 60.07 last 50.41) - open/close 3495 (time 1780383975.83 total 70.09 last 55.79) - open/close 3979 (time 1780383985.84 total 80.10 last 48.35) - open/close 4511 (time 1780383995.85 total 90.10 last 53.19) - open/close 5049 (time 1780384005.86 total 100.11 last 53.75) - open/close 5552 (time 1780384015.88 total 110.14 last 50.15) - open/close 5987 (time 1780384025.89 total 120.14 last 43.48) - open/close 6399 (time 1780384035.89 total 130.15 last 41.19) - open/close 6846 (time 1780384045.91 total 140.16 last 44.65) - open/close 7321 (time 1780384055.91 total 150.16 last 47.47) - open/close 7892 (time 1780384065.92 total 160.17 last 57.07) - open/close 8455 (time 1780384075.93 total 170.18 last 56.25) - open/close 9047 (time 1780384085.94 total 180.20 last 59.09) - open/close 9656 (time 1780384095.95 total 190.21 last 60.85) total: 10000 open/close in 196.10 seconds: 50.99 ops/second - unlinked 0 (time 1780384105 ; total 0 ; last 0) total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg440-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg440-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.140@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.140@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg440-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-OST0000 oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg440-server: oleg440-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg440-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre On OST0, 20326 used inodes rc=0 pdsh@oleg440-client: oleg440-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg440-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg440-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.140@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.140@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.140@tcp autodegrade=on sys.timeout=20 Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.140@tcp autodegrade=on sys.timeout=20 autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.140@tcp lustre:autodegrade=on lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg440-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg440-server: oleg440-server.virtnet: executing set_default_debug -1 all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-OST0000 oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg440-server: oleg440-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg440-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg440-client.virtnet: -o user_xattr,flock 192.168.204.140@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg440-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg440-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg440-server stop mds service on oleg440-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg440-server unloading modules via unload_modules_local on: 'oleg440-server' oleg440-server: oleg440-server.virtnet: executing unload_modules_local oleg440-server: modules unloaded. pdsh@oleg440-client: oleg440-client: ssh exited with exit code 2 pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 pdsh@oleg440-client: oleg440-client: ssh exited with exit code 2 PASS 69 (3286s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 03:12:38 (1780384358) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (4s) Stopping clients: oleg440-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg440-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg440-client: oleg440-server: ssh exited with exit code 2 oleg440-server: oleg440-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg440-server' oleg440-server: oleg440-server.virtnet: executing load_modules_local oleg440-server: Loading modules from /home/green/git/lustre-release/lustre oleg440-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg440-server: detected 4 online CPUs by sysfs oleg440-server: MODOPTS_LIBCFS= oleg440-server: Force libcfs to create 2 CPU partitions oleg440-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg440-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg440-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3748 sec ========== 03:13:51 (1780384431) === conf-sanity: start cleanup 03:13:53 (1780384433) === === conf-sanity: finish cleanup 03:13:56 (1780384436) ===