-----============= acceptance-small: conf-sanity ============----- Thu Jul 30 01:05:08 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg221-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682882 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg221-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg221-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg221-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg221-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg221-server oleg221-server: oleg221-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg221-server' oleg221-server: oleg221-server.virtnet: executing load_modules_local oleg221-server: Loading modules from /home/green/git/lustre-release/lustre oleg221-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg221-server: detected 4 online CPUs by sysfs oleg221-server: MODOPTS_LIBCFS= oleg221-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg221-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg221-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg221-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg221-server: oleg221-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg221-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg221-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server stop mds service on oleg221-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg221-server == conf-sanity test 45: long unlink handling in ptlrpcd == 01:09:12 (1785388152) start mds service on oleg221-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg221-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg221-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-OST0000 oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg221-client.virtnet: -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg221-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg221-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg221-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg221-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg221-client.virtnet: -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg221-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg221-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server stop mds service on oleg221-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg221-server unloading modules via unload_modules_local on: 'oleg221-server' oleg221-server: oleg221-server.virtnet: executing unload_modules_local oleg221-server: modules unloaded. pdsh@oleg221-client: oleg221-client: ssh exited with exit code 2 pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2 pdsh@oleg221-client: oleg221-client: ssh exited with exit code 2 pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2 PASS 45 (267s) == conf-sanity test 69: replace an OST with the same index ========================================================== 01:13:40 (1785388420) start mds service on oleg221-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg221-server' oleg221-server: oleg221-server.virtnet: executing load_modules_local oleg221-server: Loading modules from /home/green/git/lustre-release/lustre oleg221-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg221-server: detected 4 online CPUs by sysfs oleg221-server: MODOPTS_LIBCFS= oleg221-server: Force libcfs to create 2 CPU partitions oleg221-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg221-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg221-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg221-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg221-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-OST0000 oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg221-client.virtnet: -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11904 inodes available. Want 99872. rc=0 - open/close 677 (time 1785388535.74 total 10.01 last 67.65) - open/close 1176 (time 1785388545.74 total 20.01 last 49.88) - open/close 1730 (time 1785388555.77 total 30.03 last 55.28) - open/close 2175 (time 1785388565.78 total 40.04 last 44.45) - open/close 2537 (time 1785388575.78 total 50.04 last 36.20) - open/close 2940 (time 1785388585.78 total 60.05 last 40.28) - open/close 3472 (time 1785388595.81 total 70.07 last 53.07) - open/close 4094 (time 1785388605.81 total 80.08 last 62.16) - open/close 4554 (time 1785388615.84 total 90.10 last 45.89) - open/close 5115 (time 1785388625.85 total 100.12 last 56.01) - open/close 5965 (time 1785388635.86 total 110.13 last 84.91) - open/close 6659 (time 1785388645.90 total 120.17 last 69.14) - open/close 7109 (time 1785388655.91 total 130.17 last 44.98) - open/close 7789 (time 1785388665.91 total 140.18 last 67.97) - open/close 8224 (time 1785388675.93 total 150.20 last 43.42) - open/close 8615 (time 1785388685.94 total 160.20 last 39.07) - open/close 9115 (time 1785388695.96 total 170.23 last 49.87) - open/close 9678 (time 1785388705.98 total 180.24 last 56.21) total: 10000 open/close in 186.52 seconds: 53.61 ops/second - unlinked 0 (time 1785388718 ; total 0 ; last 0) total: 10000 unlinks in 131 seconds: 76.335876 unlinks/second - open/close 253 (time 1785388869.32 total 10.04 last 25.20) - open/close 566 (time 1785388879.33 total 20.05 last 31.26) - open/close 1051 (time 1785388889.35 total 30.07 last 48.43) - open/close 1632 (time 1785388899.36 total 40.08 last 58.04) - open/close 2204 (time 1785388909.38 total 50.10 last 57.08) - open/close 2660 (time 1785388919.39 total 60.10 last 45.57) - open/close 3245 (time 1785388929.39 total 70.11 last 58.45) - open/close 3787 (time 1785388939.40 total 80.12 last 54.17) - open/close 4236 (time 1785388949.41 total 90.13 last 44.83) - open/close 4911 (time 1785388959.43 total 100.14 last 67.43) - open/close 5543 (time 1785388969.43 total 110.14 last 63.20) - open/close 6078 (time 1785388979.44 total 120.16 last 53.43) - open/close 6613 (time 1785388989.44 total 130.16 last 53.47) - open/close 7121 (time 1785388999.45 total 140.17 last 50.76) - open/close 7546 (time 1785389009.46 total 150.18 last 42.44) - open/close 7918 (time 1785389019.49 total 160.21 last 37.11) - open/close 8381 (time 1785389029.51 total 170.23 last 46.22) - open/close 9061 (time 1785389039.54 total 180.26 last 67.79) - open/close 9697 (time 1785389049.55 total 190.26 last 63.55) total: 10000 open/close in 197.78 seconds: 50.56 ops/second - unlinked 0 (time 1785389063 ; total 0 ; last 0) total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second - open/close 351 (time 1785389187.09 total 10.00 last 35.09) - open/close 757 (time 1785389197.10 total 20.01 last 40.57) - open/close 1424 (time 1785389207.11 total 30.01 last 66.67) - open/close 2255 (time 1785389217.12 total 40.02 last 83.04) - open/close 2781 (time 1785389227.12 total 50.03 last 52.55) - open/close 3151 (time 1785389237.14 total 60.05 last 36.94) - open/close 3728 (time 1785389247.14 total 70.05 last 57.68) - open/close 4338 (time 1785389257.15 total 80.05 last 60.99) - open/close 4981 (time 1785389267.16 total 90.07 last 64.21) - open/close 5321 (time 1785389277.18 total 100.08 last 33.95) - open/close 5737 (time 1785389287.18 total 110.09 last 41.59) - open/close 6312 (time 1785389297.18 total 120.09 last 57.47) - open/close 6880 (time 1785389307.18 total 130.09 last 56.79) - open/close 7353 (time 1785389317.19 total 140.10 last 47.25) - open/close 8030 (time 1785389327.20 total 150.11 last 67.65) - open/close 8746 (time 1785389337.21 total 160.12 last 71.54) - open/close 9381 (time 1785389347.21 total 170.12 last 63.50) - open/close 9829 (time 1785389357.21 total 180.12 last 44.78) total: 10000 open/close in 184.45 seconds: 54.21 ops/second - unlinked 0 (time 1785389369 ; total 0 ; last 0) total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second - open/close 579 (time 1785389490.94 total 10.02 last 57.76) - open/close 933 (time 1785389500.95 total 20.03 last 35.37) - open/close 1269 (time 1785389510.97 total 30.06 last 33.51) - open/close 1648 (time 1785389521.01 total 40.10 last 37.75) - open/close 1980 (time 1785389531.05 total 50.13 last 33.09) - open/close 2401 (time 1785389541.05 total 60.14 last 42.09) - open/close 2809 (time 1785389551.06 total 70.15 last 40.76) - open/close 3299 (time 1785389561.08 total 80.17 last 48.91) - open/close 3739 (time 1785389571.10 total 90.18 last 43.93) - open/close 4216 (time 1785389581.12 total 100.20 last 47.61) - open/close 4717 (time 1785389591.12 total 110.20 last 50.08) - open/close 5235 (time 1785389601.13 total 120.21 last 51.75) - open/close 5927 (time 1785389611.14 total 130.22 last 69.13) - open/close 6416 (time 1785389621.15 total 140.23 last 48.85) - open/close 6847 (time 1785389631.16 total 150.24 last 43.05) - open/close 7299 (time 1785389641.16 total 160.25 last 45.19) - open/close 7892 (time 1785389651.17 total 170.26 last 59.22) - open/close 8477 (time 1785389661.18 total 180.27 last 58.44) - open/close 8907 (time 1785389671.22 total 190.30 last 42.86) - open/close 9387 (time 1785389681.25 total 200.34 last 47.83) - open/close 9772 (time 1785389691.26 total 210.35 last 38.46) total: 10000 open/close in 216.73 seconds: 46.14 ops/second - unlinked 0 (time 1785389708 ; total 0 ; last 0) total: 10000 unlinks in 125 seconds: 80.000000 unlinks/second - open/close 600 (time 1785389849.56 total 10.00 last 59.99) - open/close 1092 (time 1785389859.59 total 20.03 last 49.07) - open/close 1746 (time 1785389869.60 total 30.04 last 65.34) - open/close 2324 (time 1785389879.61 total 40.05 last 57.74) - open/close 2880 (time 1785389889.62 total 50.06 last 55.53) - open/close 3378 (time 1785389899.63 total 60.07 last 49.78) - open/close 3881 (time 1785389909.63 total 70.07 last 50.30) - open/close 4359 (time 1785389919.63 total 80.07 last 47.77) - open/close 4937 (time 1785389929.64 total 90.08 last 57.76) - open/close 5475 (time 1785389939.66 total 100.10 last 53.67) - open/close 5893 (time 1785389949.68 total 110.12 last 41.73) - open/close 6260 (time 1785389959.68 total 120.12 last 36.70) - open/close 6672 (time 1785389969.69 total 130.13 last 41.16) - open/close 7408 (time 1785389979.70 total 140.13 last 73.57) - open/close 8187 (time 1785389989.70 total 150.14 last 77.88) - open/close 8643 (time 1785389999.71 total 160.15 last 45.56) - open/close 9039 (time 1785390009.71 total 170.15 last 39.60) - open/close 9502 (time 1785390019.72 total 180.16 last 46.23) total: 10000 open/close in 187.58 seconds: 53.31 ops/second - unlinked 0 (time 1785390033 ; total 0 ; last 0) total: 10000 unlinks in 111 seconds: 90.090088 unlinks/second - open/close 601 (time 1785390160.62 total 10.01 last 60.05) - open/close 1146 (time 1785390170.65 total 20.04 last 54.33) - open/close 1716 (time 1785390180.67 total 30.06 last 56.86) - open/close 2223 (time 1785390190.68 total 40.07 last 50.67) - open/close 2681 (time 1785390200.70 total 50.09 last 45.70) - open/close 3083 (time 1785390210.70 total 60.09 last 40.19) - open/close 3686 (time 1785390220.70 total 70.09 last 60.30) - open/close 4309 (time 1785390230.71 total 80.10 last 62.26) - open/close 4781 (time 1785390240.71 total 90.11 last 47.18) - open/close 5323 (time 1785390250.72 total 100.11 last 54.18) - open/close 5860 (time 1785390260.72 total 110.11 last 53.69) - open/close 6489 (time 1785390270.73 total 120.12 last 62.85) - open/close 7080 (time 1785390280.74 total 130.13 last 59.01) - open/close 7866 (time 1785390290.75 total 140.14 last 78.56) - open/close 8629 (time 1785390300.76 total 150.15 last 76.23) - open/close 9165 (time 1785390310.77 total 160.16 last 53.52) - open/close 9717 (time 1785390320.80 total 170.20 last 55.02) total: 10000 open/close in 175.81 seconds: 56.88 ops/second - unlinked 0 (time 1785390331 ; total 0 ; last 0) total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second - open/close 396 (time 1785390454.39 total 10.00 last 39.59) - open/close 969 (time 1785390464.40 total 20.01 last 57.27) - open/close 1507 (time 1785390474.40 total 30.01 last 53.79) - open/close 2172 (time 1785390484.40 total 40.01 last 66.46) - open/close 2834 (time 1785390494.41 total 50.02 last 66.18) - open/close 3285 (time 1785390504.41 total 60.02 last 45.09) - open/close 3766 (time 1785390514.42 total 70.03 last 48.05) - open/close 4540 (time 1785390524.44 total 80.05 last 77.23) - open/close 5043 (time 1785390534.44 total 90.05 last 50.28) - open/close 5888 (time 1785390544.45 total 100.06 last 84.45) - open/close 6668 (time 1785390554.47 total 110.08 last 77.83) - open/close 7392 (time 1785390564.48 total 120.09 last 72.37) - open/close 8220 (time 1785390574.49 total 130.10 last 82.68) - open/close 8759 (time 1785390584.50 total 140.11 last 53.83) - open/close 9265 (time 1785390594.51 total 150.12 last 50.56) - open/close 9785 (time 1785390604.52 total 160.13 last 51.97) total: 10000 open/close in 165.85 seconds: 60.30 ops/second - unlinked 0 (time 1785390619 ; total 0 ; last 0) total: 10000 unlinks in 129 seconds: 77.519379 unlinks/second - open/close 516 (time 1785390766.57 total 10.01 last 51.54) - open/close 1179 (time 1785390776.57 total 20.01 last 66.29) - open/close 1626 (time 1785390786.57 total 30.02 last 44.68) - open/close 2064 (time 1785390796.57 total 40.02 last 43.79) - open/close 2568 (time 1785390806.58 total 50.03 last 50.36) - open/close 3283 (time 1785390816.61 total 60.05 last 71.33) - open/close 3784 (time 1785390826.62 total 70.06 last 50.05) - open/close 4268 (time 1785390836.64 total 80.08 last 48.31) - open/close 4746 (time 1785390846.66 total 90.10 last 47.70) - open/close 5170 (time 1785390856.67 total 100.11 last 42.35) - open/close 5630 (time 1785390866.68 total 110.12 last 45.95) - open/close 6178 (time 1785390876.68 total 120.13 last 54.79) - open/close 7057 (time 1785390886.69 total 130.13 last 87.85) - open/close 7788 (time 1785390896.72 total 140.17 last 72.82) - open/close 8358 (time 1785390906.73 total 150.18 last 56.95) - open/close 8856 (time 1785390916.75 total 160.20 last 49.70) - open/close 9327 (time 1785390926.75 total 170.20 last 47.10) - open/close 9740 (time 1785390936.77 total 180.22 last 41.22) total: 10000 open/close in 186.56 seconds: 53.60 ops/second - unlinked 0 (time 1785390950 ; total 0 ; last 0) total: 10000 unlinks in 117 seconds: 85.470085 unlinks/second - open/close 567 (time 1785391083.02 total 10.01 last 56.65) - open/close 1003 (time 1785391093.02 total 20.01 last 43.59) - open/close 1549 (time 1785391103.02 total 30.01 last 54.59) - open/close 2093 (time 1785391113.04 total 40.03 last 54.32) - open/close 2651 (time 1785391123.05 total 50.04 last 55.71) - open/close 3295 (time 1785391133.06 total 60.05 last 64.36) - open/close 4178 (time 1785391143.06 total 70.05 last 88.30) - open/close 4777 (time 1785391153.07 total 80.06 last 59.83) - open/close 5306 (time 1785391163.09 total 90.08 last 52.82) - open/close 5793 (time 1785391173.09 total 100.08 last 48.67) - open/close 6290 (time 1785391183.11 total 110.10 last 49.62) - open/close 6761 (time 1785391193.12 total 120.11 last 47.05) - open/close 7385 (time 1785391203.13 total 130.12 last 62.31) - open/close 7871 (time 1785391213.13 total 140.12 last 48.60) - open/close 8542 (time 1785391223.14 total 150.13 last 67.03) - open/close 9205 (time 1785391233.15 total 160.15 last 66.23) - open/close 9776 (time 1785391243.16 total 170.15 last 57.08) total: 10000 open/close in 174.56 seconds: 57.29 ops/second - unlinked 0 (time 1785391254 ; total 0 ; last 0) total: 10000 unlinks in 128 seconds: 78.125000 unlinks/second - open/close 450 (time 1785391398.40 total 10.01 last 44.93) - open/close 857 (time 1785391408.41 total 20.03 last 40.65) - open/close 1394 (time 1785391418.41 total 30.03 last 53.70) - open/close 1776 (time 1785391428.44 total 40.05 last 38.11) - open/close 2234 (time 1785391438.44 total 50.06 last 45.78) - open/close 2792 (time 1785391448.44 total 60.06 last 55.78) - open/close 3481 (time 1785391458.44 total 70.06 last 68.89) - open/close 4368 (time 1785391468.45 total 80.06 last 88.69) - open/close 5272 (time 1785391478.47 total 90.08 last 90.21) - open/close 5738 (time 1785391488.47 total 100.09 last 46.58) - open/close 6450 (time 1785391498.48 total 110.10 last 71.13) - open/close 7578 (time 1785391508.49 total 120.10 last 112.71) - open/close 8321 (time 1785391518.49 total 130.11 last 74.27) - open/close 8846 (time 1785391528.50 total 140.12 last 52.46) - open/close 9559 (time 1785391538.50 total 150.12 last 71.27) total: 10000 open/close in 156.02 seconds: 64.09 ops/second - unlinked 0 (time 1785391548 ; total 0 ; last 0) total: 10000 unlinks in 114 seconds: 87.719299 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg221-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg221-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.121@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.121@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg221-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-OST0000 oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg221-server: oleg221-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg221-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg221-client.virtnet: -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre On OST0, 20326 used inodes rc=0 pdsh@oleg221-client: oleg221-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg221-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg221-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.202.121@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.121@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: sys.timeout=20 autodegrade=on mgsnode=192.168.202.121@tcp Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: sys.timeout=20 autodegrade=on mgsnode=192.168.202.121@tcp autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:sys.timeout=20 lustre:autodegrade=on lustre:mgsnode=192.168.202.121@tcp lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg221-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg221-server: oleg221-server.virtnet: executing set_default_debug -1 all pdsh@oleg221-client: oleg221-server: ssh exited with exit code 1 Started lustre-OST0000 oleg221-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg221-server: oleg221-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg221-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg221-client.virtnet: -o user_xattr,flock 192.168.202.121@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg221-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg221-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg221-server stop mds service on oleg221-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg221-server unloading modules via unload_modules_local on: 'oleg221-server' oleg221-server: oleg221-server.virtnet: executing unload_modules_local oleg221-server: modules unloaded. pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2 pdsh@oleg221-client: oleg221-client: ssh exited with exit code 2 pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2 pdsh@oleg221-client: oleg221-client: ssh exited with exit code 2 PASS 69 (3461s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 02:11:22 (1785391882) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (4s) Stopping clients: oleg221-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg221-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg221-client: oleg221-server: ssh exited with exit code 2 oleg221-server: oleg221-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg221-server' oleg221-server: oleg221-server.virtnet: executing load_modules_local oleg221-server: Loading modules from /home/green/git/lustre-release/lustre oleg221-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg221-server: detected 4 online CPUs by sysfs oleg221-server: MODOPTS_LIBCFS= oleg221-server: Force libcfs to create 2 CPU partitions oleg221-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg221-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg221-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 4081 sec ========== 02:13:12 (1785391992) === conf-sanity: start cleanup 02:13:16 (1785391996) === === conf-sanity: finish cleanup 02:13:20 (1785392000) ===