-----============= acceptance-small: conf-sanity ============----- Fri Oct 2 15:54:01 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky use CONF_SANITY_ONLY='' CONF_SANITY_EXCEPT='' oleg417-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION >= v2_15_63-53-g1a6ef725c2 (34683650 >= 34553653) for LU-16938, go 81 - see CLIENT_VERSION >= v2_15_65-31-g74a5b9efaa (34683650 >= 34554143) for LU-18348, go 32b 32c - see CLIENT_VERSION >= v2_16_55-19-gf69f27cc35 (34683650 >= 34617107) for LU-17920, go 123ae 123ag - see CLIENT_VERSION >= v2_17_52-94-g86904ef943 (34683650 >= 34681950) for LU-19740, go 115 only running tests: 45 69 111 excepting tests: 32b 32c 32newtarball 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg417-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg417-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg417-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg417-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg417-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg417-server oleg417-server: oleg417-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: kmemleak disabled oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: MODOPTS_LIBCFS= oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg417-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg417-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg417-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg417-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg417-server: oleg417-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg417-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg417-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg417-server stop mds service on oleg417-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg417-server repeat= (ONLY_REPEAT=) repeat_end= (ONLY_MINUTES=) == conf-sanity test 45: long unlink handling in ptlrpcd == 15:57:07 (1790971027) start mds service on oleg417-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg417-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg417-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-OST0000 oleg417-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg417-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg417-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg417-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg417-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg417-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg417-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg417-server stop mds service on oleg417-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg417-server unloading modules via unload_modules_local on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing unload_modules_local oleg417-server: kmemleak disabled modules unloaded. pdsh@oleg417-client: oleg417-client: ssh exited with exit code 2 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 pdsh@oleg417-client: oleg417-client: ssh exited with exit code 2 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 PASS 45 (228s) repeat= (ONLY_REPEAT=) repeat_end= (ONLY_MINUTES=) == conf-sanity test 69: replace an OST with the same index ========================================================== 16:00:56 (1790971256) start mds service on oleg417-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x. 1 green green 1946968 Oct 2 13:55 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: kmemleak disabled oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: MODOPTS_LIBCFS= oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg417-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg417-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg417-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg417-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg417-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-OST0000 oleg417-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11904 inodes available. Want 99872. rc=0 - open/close 614 (time 1790971352.90 total 10.01 last 61.36) - open/close 1203 (time 1790971362.90 total 20.01 last 58.89) - open/close 1795 (time 1790971372.90 total 30.01 last 59.18) - open/close 2349 (time 1790971382.94 total 40.05 last 55.20) - open/close 2866 (time 1790971392.94 total 50.05 last 51.68) - open/close 3464 (time 1790971402.95 total 60.06 last 59.77) - open/close 4016 (time 1790971412.97 total 70.08 last 55.09) - open/close 4661 (time 1790971422.97 total 80.08 last 64.48) - open/close 5184 (time 1790971432.98 total 90.09 last 52.24) - open/close 5733 (time 1790971442.99 total 100.10 last 54.87) - open/close 6248 (time 1790971452.99 total 110.10 last 51.47) - open/close 6768 (time 1790971463.01 total 120.12 last 51.92) - open/close 7236 (time 1790971473.03 total 130.14 last 46.72) - open/close 7745 (time 1790971483.04 total 140.15 last 50.83) - open/close 8333 (time 1790971493.05 total 150.16 last 58.76) - open/close 8953 (time 1790971503.06 total 160.17 last 61.95) - open/close 9639 (time 1790971513.06 total 170.17 last 68.54) total: 10000 open/close in 176.66 seconds: 56.61 ops/second - unlinked 0 (time 1790971524 ; total 0 ; last 0) total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second - open/close 506 (time 1790971647.84 total 10.01 last 50.55) - open/close 1039 (time 1790971657.85 total 20.01 last 53.27) - open/close 1627 (time 1790971667.86 total 30.03 last 58.74) - open/close 2255 (time 1790971677.87 total 40.04 last 62.70) - open/close 2842 (time 1790971687.88 total 50.05 last 58.66) - open/close 3455 (time 1790971697.90 total 60.07 last 61.19) - open/close 3950 (time 1790971707.92 total 70.08 last 49.42) - open/close 4397 (time 1790971717.94 total 80.10 last 44.61) - open/close 4878 (time 1790971727.95 total 90.12 last 48.01) - open/close 5450 (time 1790971737.96 total 100.13 last 57.17) - open/close 6118 (time 1790971747.97 total 110.13 last 66.76) - open/close 6715 (time 1790971757.97 total 120.14 last 59.67) - open/close 7309 (time 1790971767.98 total 130.15 last 59.35) - open/close 7959 (time 1790971777.99 total 140.15 last 64.96) - open/close 8673 (time 1790971788.00 total 150.16 last 71.34) - open/close 9319 (time 1790971798.01 total 160.17 last 64.53) - open/close 9936 (time 1790971808.02 total 170.18 last 61.64) total: 10000 open/close in 171.26 seconds: 58.39 ops/second - unlinked 0 (time 1790971814 ; total 0 ; last 0) total: 10000 unlinks in 89 seconds: 112.359550 unlinks/second - open/close 655 (time 1790971919.14 total 10.00 last 65.49) - open/close 1345 (time 1790971929.15 total 20.01 last 68.94) - open/close 2010 (time 1790971939.15 total 30.02 last 66.46) - open/close 2708 (time 1790971949.15 total 40.02 last 69.79) - open/close 3362 (time 1790971959.16 total 50.02 last 65.38) - open/close 4039 (time 1790971969.17 total 60.03 last 67.63) - open/close 4712 (time 1790971979.18 total 70.04 last 67.23) - open/close 5357 (time 1790971989.18 total 80.04 last 64.49) - open/close 6015 (time 1790971999.20 total 90.06 last 65.68) - open/close 6625 (time 1790972009.20 total 100.07 last 60.96) - open/close 7313 (time 1790972019.21 total 110.07 last 68.78) - open/close 8012 (time 1790972029.21 total 120.07 last 69.89) - open/close 8706 (time 1790972039.21 total 130.07 last 69.37) - open/close 9354 (time 1790972049.21 total 140.07 last 64.80) - open/close 9943 (time 1790972059.22 total 150.09 last 58.84) total: 10000 open/close in 151.17 seconds: 66.15 ops/second - unlinked 0 (time 1790972065 ; total 0 ; last 0) total: 10000 unlinks in 91 seconds: 109.890106 unlinks/second - open/close 592 (time 1790972171.06 total 10.02 last 59.10) - open/close 1261 (time 1790972181.07 total 20.02 last 66.88) - open/close 1884 (time 1790972191.07 total 30.02 last 62.30) - open/close 2472 (time 1790972201.08 total 40.03 last 58.75) - open/close 3086 (time 1790972211.10 total 50.05 last 61.24) - open/close 3688 (time 1790972221.12 total 60.07 last 60.09) - open/close 4357 (time 1790972231.12 total 70.07 last 66.89) - open/close 4921 (time 1790972241.16 total 80.11 last 56.19) - open/close 5542 (time 1790972251.16 total 90.11 last 62.10) - open/close 6163 (time 1790972261.17 total 100.12 last 62.04) - open/close 6788 (time 1790972271.18 total 110.13 last 62.44) - open/close 7397 (time 1790972281.19 total 120.14 last 60.82) - open/close 7990 (time 1790972291.19 total 130.15 last 59.29) - open/close 8609 (time 1790972301.22 total 140.17 last 61.77) - open/close 9244 (time 1790972311.25 total 150.20 last 63.30) - open/close 9771 (time 1790972321.25 total 160.21 last 52.66) total: 10000 open/close in 163.63 seconds: 61.11 ops/second - unlinked 0 (time 1790972329 ; total 0 ; last 0) total: 10000 unlinks in 106 seconds: 94.339622 unlinks/second - open/close 571 (time 1790972450.14 total 10.01 last 57.05) - open/close 1230 (time 1790972460.14 total 20.01 last 65.87) - open/close 1868 (time 1790972470.15 total 30.03 last 63.72) - open/close 2474 (time 1790972480.16 total 40.04 last 60.54) - open/close 3084 (time 1790972490.17 total 50.05 last 60.93) - open/close 3633 (time 1790972500.20 total 60.08 last 54.73) - open/close 4204 (time 1790972510.20 total 70.08 last 57.10) - open/close 4785 (time 1790972520.21 total 80.08 last 58.05) - open/close 5376 (time 1790972530.24 total 90.12 last 58.92) - open/close 5834 (time 1790972540.26 total 100.13 last 45.72) - open/close 6123 (time 1790972550.27 total 110.15 last 28.87) - open/close 6565 (time 1790972560.28 total 120.15 last 44.16) - open/close 7048 (time 1790972570.29 total 130.16 last 48.28) - open/close 7472 (time 1790972580.29 total 140.17 last 42.36) - open/close 8007 (time 1790972590.31 total 150.18 last 53.41) - open/close 8643 (time 1790972600.32 total 160.19 last 63.54) - open/close 9197 (time 1790972610.33 total 170.20 last 55.35) - open/close 9842 (time 1790972620.33 total 180.21 last 64.48) total: 10000 open/close in 182.31 seconds: 54.85 ops/second - unlinked 0 (time 1790972628 ; total 0 ; last 0) total: 10000 unlinks in 108 seconds: 92.592590 unlinks/second - open/close 600 (time 1790972751.16 total 10.02 last 59.90) - open/close 1181 (time 1790972761.17 total 20.02 last 58.07) - open/close 1733 (time 1790972771.19 total 30.04 last 55.09) - open/close 2292 (time 1790972781.19 total 40.05 last 55.88) - open/close 2884 (time 1790972791.20 total 50.05 last 59.16) - open/close 3425 (time 1790972801.20 total 60.05 last 54.10) - open/close 4023 (time 1790972811.20 total 70.06 last 59.76) - open/close 4619 (time 1790972821.23 total 80.08 last 59.48) - open/close 5189 (time 1790972831.24 total 90.09 last 56.92) - open/close 5804 (time 1790972841.25 total 100.10 last 61.45) - open/close 6447 (time 1790972851.26 total 110.11 last 64.25) - open/close 6994 (time 1790972861.27 total 120.12 last 54.65) - open/close 7480 (time 1790972871.28 total 130.14 last 48.52) - open/close 8017 (time 1790972881.30 total 140.15 last 53.63) - open/close 8561 (time 1790972891.31 total 150.16 last 54.34) - open/close 9090 (time 1790972901.32 total 160.17 last 52.84) - open/close 9583 (time 1790972911.33 total 170.19 last 49.24) total: 10000 open/close in 177.86 seconds: 56.22 ops/second - unlinked 0 (time 1790972924 ; total 0 ; last 0) total: 10000 unlinks in 112 seconds: 89.285713 unlinks/second - open/close 557 (time 1790973052.46 total 10.01 last 55.64) - open/close 1157 (time 1790973062.47 total 20.02 last 59.95) - open/close 1740 (time 1790973072.48 total 30.03 last 58.23) - open/close 2332 (time 1790973082.49 total 40.04 last 59.14) - open/close 2847 (time 1790973092.51 total 50.06 last 51.42) - open/close 3438 (time 1790973102.53 total 60.08 last 58.99) - open/close 4092 (time 1790973112.53 total 70.08 last 65.38) - open/close 4763 (time 1790973122.54 total 80.09 last 67.06) - open/close 5395 (time 1790973132.54 total 90.09 last 63.16) - open/close 5983 (time 1790973142.55 total 100.10 last 58.77) - open/close 6556 (time 1790973152.56 total 110.11 last 57.23) - open/close 7206 (time 1790973162.56 total 120.11 last 64.99) - open/close 7850 (time 1790973172.58 total 130.13 last 64.29) - open/close 8448 (time 1790973182.59 total 140.14 last 59.73) - open/close 9101 (time 1790973192.61 total 150.16 last 65.19) - open/close 9725 (time 1790973202.61 total 160.16 last 62.36) total: 10000 open/close in 164.48 seconds: 60.80 ops/second - unlinked 0 (time 1790973211 ; total 0 ; last 0) total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second - open/close 628 (time 1790973330.97 total 10.00 last 62.80) - open/close 1241 (time 1790973340.98 total 20.01 last 61.24) - open/close 1857 (time 1790973351.00 total 30.03 last 61.49) - open/close 2529 (time 1790973361.01 total 40.04 last 67.13) - open/close 3161 (time 1790973371.01 total 50.04 last 63.17) - open/close 3780 (time 1790973381.02 total 60.05 last 61.83) - open/close 4310 (time 1790973391.03 total 70.06 last 52.95) - open/close 4895 (time 1790973401.03 total 80.06 last 58.49) - open/close 5443 (time 1790973411.03 total 90.07 last 54.79) - open/close 6065 (time 1790973421.04 total 100.07 last 62.19) - open/close 6614 (time 1790973431.04 total 110.07 last 54.88) - open/close 7190 (time 1790973441.06 total 120.10 last 57.46) - open/close 7779 (time 1790973451.09 total 130.12 last 58.75) - open/close 8291 (time 1790973461.10 total 140.13 last 51.16) - open/close 8873 (time 1790973471.11 total 150.14 last 58.11) - open/close 9443 (time 1790973481.12 total 160.15 last 56.94) total: 10000 open/close in 169.22 seconds: 59.10 ops/second - unlinked 0 (time 1790973495 ; total 0 ; last 0) total: 10000 unlinks in 97 seconds: 103.092781 unlinks/second - open/close 618 (time 1790973607.70 total 10.01 last 61.77) - open/close 1286 (time 1790973617.70 total 20.01 last 66.79) - open/close 1930 (time 1790973627.73 total 30.04 last 64.18) - open/close 2576 (time 1790973637.74 total 40.05 last 64.53) - open/close 3178 (time 1790973647.75 total 50.05 last 60.18) - open/close 3798 (time 1790973657.75 total 60.06 last 61.97) - open/close 4294 (time 1790973667.76 total 70.07 last 49.55) - open/close 4919 (time 1790973677.78 total 80.09 last 62.39) - open/close 5376 (time 1790973687.80 total 90.11 last 45.60) - open/close 5729 (time 1790973697.82 total 100.12 last 35.25) - open/close 6185 (time 1790973707.82 total 110.13 last 45.57) - open/close 6664 (time 1790973717.86 total 120.16 last 47.74) - open/close 7127 (time 1790973727.87 total 130.18 last 46.24) - open/close 7677 (time 1790973737.88 total 140.19 last 54.93) - open/close 8197 (time 1790973747.89 total 150.20 last 51.96) - open/close 8733 (time 1790973757.90 total 160.21 last 53.55) - open/close 9315 (time 1790973767.91 total 170.22 last 58.13) - open/close 9827 (time 1790973777.92 total 180.22 last 51.18) total: 10000 open/close in 183.76 seconds: 54.42 ops/second - unlinked 0 (time 1790973786 ; total 0 ; last 0) total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second - open/close 642 (time 1790973903.48 total 10.00 last 64.17) - open/close 1268 (time 1790973913.48 total 20.01 last 62.57) - open/close 1888 (time 1790973923.48 total 30.01 last 62.00) - open/close 2507 (time 1790973933.49 total 40.02 last 61.84) - open/close 2913 (time 1790973943.50 total 50.03 last 40.55) - open/close 3546 (time 1790973953.51 total 60.03 last 63.29) - open/close 4140 (time 1790973963.53 total 70.06 last 59.26) - open/close 4709 (time 1790973973.55 total 80.08 last 56.78) - open/close 5334 (time 1790973983.55 total 90.08 last 62.48) - open/close 5963 (time 1790973993.56 total 100.09 last 62.86) - open/close 6484 (time 1790974003.59 total 110.12 last 51.96) - open/close 6884 (time 1790974013.61 total 120.14 last 39.91) - open/close 7440 (time 1790974023.64 total 130.16 last 55.45) - open/close 7968 (time 1790974033.64 total 140.17 last 52.77) - open/close 8540 (time 1790974043.66 total 150.19 last 57.10) - open/close 9160 (time 1790974053.68 total 160.21 last 61.83) - open/close 9757 (time 1790974063.69 total 170.22 last 59.68) total: 10000 open/close in 174.38 seconds: 57.35 ops/second - unlinked 0 (time 1790974072 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg417-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg417-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg417-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.117@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.117@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg417-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-OST0000 oleg417-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg417-server: oleg417-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg417-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre On OST0, 20326 used inodes rc=0 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg417-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg417-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg417-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.117@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.117@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: sys.timeout=20 mgsnode=192.168.204.117@tcp autodegrade=on Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: sys.timeout=20 mgsnode=192.168.204.117@tcp autodegrade=on autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:sys.timeout=20 lustre:mgsnode=192.168.204.117@tcp lustre:autodegrade=on lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg417-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg417-server: oleg417-server.virtnet: executing set_default_debug -1 all pdsh@oleg417-client: oleg417-server: ssh exited with exit code 1 Started lustre-OST0000 oleg417-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg417-server: oleg417-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg417-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg417-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg417-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg417-server stop mds service on oleg417-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg417-server unloading modules via unload_modules_local on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing unload_modules_local oleg417-server: kmemleak disabled modules unloaded. pdsh@oleg417-client: oleg417-client: ssh exited with exit code 2 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 pdsh@oleg417-client: oleg417-client: ssh exited with exit code 2 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 PASS 69 (3050s) repeat= (ONLY_REPEAT=) repeat_end= (ONLY_MINUTES=) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 16:51:47 (1790974307) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (2s) Stopping clients: oleg417-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg417-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 oleg417-server: oleg417-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x. 1 green green 1946968 Oct 2 13:55 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: kmemleak disabled oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: MODOPTS_LIBCFS= oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg417-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg417-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg417-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3537 sec ========== 16:52:59 (1790974379) === conf-sanity: start cleanup 16:53:01 (1790974381) === === conf-sanity: finish cleanup 16:53:04 (1790974384) ===