-----============= acceptance-small: conf-sanity ============----- Sun Nov 16 20:57:48 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg239-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg239-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg239-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg239-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg239-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg239-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg239-server oleg239-server: oleg239-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg239-server' oleg239-server: oleg239-server.virtnet: executing load_modules_local oleg239-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg239-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg239-server: Loading modules from /home/green/git/lustre-release/lustre oleg239-server: detected 4 online CPUs by sysfs oleg239-server: MODOPTS_LIBCFS= oleg239-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg239-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg239-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg239-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg239-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg239-server: oleg239-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg239-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg239-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg239-server stop mds service on oleg239-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg239-server == conf-sanity test 45: long unlink handling in ptlrpcd == 21:00:03 (1763344803) start mds service on oleg239-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg239-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg239-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-OST0000 oleg239-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg239-client.virtnet: -o user_xattr,flock 192.168.202.139@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg239-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg239-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg239-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg239-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg239-client.virtnet: -o user_xattr,flock 192.168.202.139@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg239-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg239-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg239-server stop mds service on oleg239-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg239-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg239-server' oleg239-server: oleg239-server.virtnet: executing unload_modules_local oleg239-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg239-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg239-client: oleg239-client: ssh exited with exit code 2 pdsh@oleg239-client: oleg239-server: ssh exited with exit code 2 pdsh@oleg239-client: oleg239-client: ssh exited with exit code 2 pdsh@oleg239-client: oleg239-server: ssh exited with exit code 2 PASS 45 (194s) == conf-sanity test 69: replace an OST with the same index ========================================================== 21:03:18 (1763344998) start mds service on oleg239-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg239-server' oleg239-server: oleg239-server.virtnet: executing load_modules_local oleg239-server: Loading modules from /home/green/git/lustre-release/lustre oleg239-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg239-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg239-server: detected 4 online CPUs by sysfs oleg239-server: MODOPTS_LIBCFS= oleg239-server: Force libcfs to create 2 CPU partitions oleg239-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg239-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg239-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg239-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-OST0000 oleg239-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg239-client.virtnet: -o user_xattr,flock 192.168.202.139@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 683 (time 1763345077.09 total 10.01 last 68.26) - open/close 1402 (time 1763345087.09 total 20.01 last 71.87) - open/close 2135 (time 1763345097.10 total 30.02 last 73.22) - open/close 2813 (time 1763345107.10 total 40.02 last 67.80) - open/close 3536 (time 1763345117.12 total 50.03 last 72.21) - open/close 4235 (time 1763345127.12 total 60.04 last 69.89) - open/close 4881 (time 1763345137.12 total 70.04 last 64.56) - open/close 5577 (time 1763345147.12 total 80.04 last 69.60) - open/close 6236 (time 1763345157.13 total 90.04 last 65.89) - open/close 6885 (time 1763345167.13 total 100.05 last 64.84) - open/close 7529 (time 1763345177.16 total 110.07 last 64.27) - open/close 8219 (time 1763345187.16 total 120.08 last 68.96) - open/close 8938 (time 1763345197.16 total 130.08 last 71.89) - open/close 9611 (time 1763345207.18 total 140.10 last 67.16) total: 10000 open/close in 145.72 seconds: 68.63 ops/second - unlinked 0 (time 1763345216 ; total 0 ; last 0) total: 10000 unlinks in 86 seconds: 116.279068 unlinks/second - open/close 621 (time 1763345315.94 total 10.01 last 62.06) - open/close 1257 (time 1763345325.95 total 20.02 last 63.54) - open/close 1858 (time 1763345335.96 total 30.03 last 60.04) - open/close 2490 (time 1763345345.97 total 40.03 last 63.15) - open/close 3149 (time 1763345355.98 total 50.05 last 65.79) - open/close 3846 (time 1763345365.99 total 60.05 last 69.68) - open/close 4522 (time 1763345375.99 total 70.05 last 67.59) - open/close 5182 (time 1763345386.00 total 80.06 last 65.94) - open/close 5851 (time 1763345396.00 total 90.07 last 66.86) - open/close 6509 (time 1763345406.01 total 100.08 last 65.73) - open/close 7214 (time 1763345416.01 total 110.08 last 70.49) - open/close 7926 (time 1763345426.03 total 120.09 last 71.12) - open/close 8602 (time 1763345436.03 total 130.10 last 67.57) - open/close 9201 (time 1763345446.03 total 140.10 last 59.88) - open/close 9885 (time 1763345456.05 total 150.12 last 68.27) total: 10000 open/close in 151.85 seconds: 65.85 ops/second - unlinked 0 (time 1763345462 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 624 (time 1763345573.04 total 10.02 last 62.27) - open/close 1295 (time 1763345583.04 total 20.02 last 67.08) - open/close 1937 (time 1763345593.05 total 30.03 last 64.18) - open/close 2589 (time 1763345603.05 total 40.03 last 65.18) - open/close 3254 (time 1763345613.05 total 50.03 last 66.48) - open/close 3954 (time 1763345623.06 total 60.04 last 69.97) - open/close 4658 (time 1763345633.07 total 70.05 last 70.34) - open/close 5413 (time 1763345643.09 total 80.07 last 75.35) - open/close 6095 (time 1763345653.09 total 90.07 last 68.17) - open/close 6794 (time 1763345663.09 total 100.07 last 69.90) - open/close 7477 (time 1763345673.09 total 110.07 last 68.29) - open/close 8177 (time 1763345683.10 total 120.08 last 69.95) - open/close 8886 (time 1763345693.13 total 130.11 last 70.68) - open/close 9599 (time 1763345703.13 total 140.11 last 71.28) total: 10000 open/close in 146.26 seconds: 68.37 ops/second - unlinked 0 (time 1763345712 ; total 0 ; last 0) total: 10000 unlinks in 86 seconds: 116.279068 unlinks/second - open/close 515 (time 1763345813.97 total 10.02 last 51.38) - open/close 1097 (time 1763345823.98 total 20.03 last 58.15) - open/close 1688 (time 1763345833.98 total 30.04 last 59.08) - open/close 2340 (time 1763345844.00 total 40.05 last 65.11) - open/close 2962 (time 1763345854.02 total 50.07 last 62.08) - open/close 3609 (time 1763345864.02 total 60.07 last 64.67) - open/close 4269 (time 1763345874.03 total 70.08 last 65.93) - open/close 4875 (time 1763345884.05 total 80.11 last 60.46) - open/close 5533 (time 1763345894.06 total 90.11 last 65.74) - open/close 6175 (time 1763345904.08 total 100.13 last 64.08) - open/close 6816 (time 1763345914.09 total 110.14 last 64.03) - open/close 7419 (time 1763345924.12 total 120.17 last 60.14) - open/close 8092 (time 1763345934.12 total 130.17 last 67.28) - open/close 8645 (time 1763345944.13 total 140.18 last 55.26) - open/close 9261 (time 1763345954.14 total 150.19 last 61.55) - open/close 9936 (time 1763345964.16 total 160.21 last 67.34) total: 10000 open/close in 161.23 seconds: 62.02 ops/second - unlinked 0 (time 1763345969 ; total 0 ; last 0) total: 10000 unlinks in 86 seconds: 116.279068 unlinks/second - open/close 633 (time 1763346068.61 total 10.00 last 63.30) - open/close 1228 (time 1763346078.61 total 20.00 last 59.50) - open/close 1825 (time 1763346088.61 total 30.01 last 59.65) - open/close 2453 (time 1763346098.62 total 40.01 last 62.77) - open/close 3134 (time 1763346108.63 total 50.02 last 68.06) - open/close 3808 (time 1763346118.64 total 60.03 last 67.32) - open/close 4513 (time 1763346128.64 total 70.03 last 70.50) - open/close 5175 (time 1763346138.65 total 80.04 last 66.14) - open/close 5813 (time 1763346148.66 total 90.05 last 63.74) - open/close 6485 (time 1763346158.66 total 100.06 last 67.17) - open/close 7079 (time 1763346168.68 total 110.07 last 59.31) - open/close 7665 (time 1763346178.68 total 120.07 last 58.60) - open/close 8327 (time 1763346188.68 total 130.08 last 66.16) - open/close 8965 (time 1763346198.69 total 140.09 last 63.74) - open/close 9596 (time 1763346208.70 total 150.09 last 63.08) total: 10000 open/close in 156.27 seconds: 63.99 ops/second - unlinked 0 (time 1763346218 ; total 0 ; last 0) total: 10000 unlinks in 88 seconds: 113.636360 unlinks/second - open/close 610 (time 1763346319.83 total 10.01 last 60.96) - open/close 1178 (time 1763346329.84 total 20.01 last 56.77) - open/close 1696 (time 1763346339.85 total 30.02 last 51.73) - open/close 2254 (time 1763346349.87 total 40.04 last 55.68) - open/close 2935 (time 1763346359.88 total 50.05 last 68.04) - open/close 3575 (time 1763346369.89 total 60.06 last 63.93) - open/close 4224 (time 1763346379.91 total 70.09 last 64.76) - open/close 4889 (time 1763346389.92 total 80.09 last 66.49) - open/close 5585 (time 1763346399.93 total 90.10 last 69.53) - open/close 6278 (time 1763346409.94 total 100.11 last 69.21) - open/close 6922 (time 1763346419.94 total 110.12 last 64.36) - open/close 7707 (time 1763346429.95 total 120.12 last 78.49) - open/close 8306 (time 1763346439.95 total 130.12 last 59.87) - open/close 8952 (time 1763346449.97 total 140.14 last 64.51) - open/close 9575 (time 1763346459.97 total 150.14 last 62.29) total: 10000 open/close in 156.58 seconds: 63.87 ops/second - unlinked 0 (time 1763346470 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 697 (time 1763346574.29 total 10.01 last 69.64) - open/close 1362 (time 1763346584.31 total 20.02 last 66.39) - open/close 1987 (time 1763346594.31 total 30.03 last 62.49) - open/close 2613 (time 1763346604.32 total 40.03 last 62.57) - open/close 3258 (time 1763346614.32 total 50.04 last 64.45) - open/close 3943 (time 1763346624.33 total 60.05 last 68.43) - open/close 4590 (time 1763346634.34 total 70.05 last 64.67) - open/close 5184 (time 1763346644.35 total 80.06 last 59.33) - open/close 5845 (time 1763346654.35 total 90.07 last 66.08) - open/close 6481 (time 1763346664.38 total 100.09 last 63.43) - open/close 7194 (time 1763346674.39 total 110.11 last 71.20) - open/close 7815 (time 1763346684.39 total 120.11 last 62.09) - open/close 8393 (time 1763346694.40 total 130.11 last 57.79) - open/close 8987 (time 1763346704.40 total 140.12 last 59.37) - open/close 9669 (time 1763346714.42 total 150.14 last 68.04) total: 10000 open/close in 154.97 seconds: 64.53 ops/second - unlinked 0 (time 1763346723 ; total 0 ; last 0) total: 10000 unlinks in 87 seconds: 114.942528 unlinks/second - open/close 700 (time 1763346824.27 total 10.01 last 69.95) - open/close 1398 (time 1763346834.28 total 20.02 last 69.69) - open/close 2049 (time 1763346844.30 total 30.04 last 64.99) - open/close 2650 (time 1763346854.32 total 40.06 last 59.98) - open/close 3301 (time 1763346864.33 total 50.06 last 65.06) - open/close 3926 (time 1763346874.34 total 60.08 last 62.40) - open/close 4388 (time 1763346884.35 total 70.09 last 46.15) - open/close 5050 (time 1763346894.36 total 80.10 last 66.14) - open/close 5743 (time 1763346904.38 total 90.12 last 69.17) - open/close 6396 (time 1763346914.38 total 100.12 last 65.28) - open/close 6989 (time 1763346924.39 total 110.13 last 59.26) - open/close 7610 (time 1763346934.39 total 120.13 last 62.09) - open/close 8218 (time 1763346944.39 total 130.13 last 60.80) - open/close 8850 (time 1763346954.40 total 140.14 last 63.13) - open/close 9490 (time 1763346964.40 total 150.14 last 63.99) total: 10000 open/close in 157.22 seconds: 63.61 ops/second - unlinked 0 (time 1763346975 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 685 (time 1763347079.45 total 10.01 last 68.46) - open/close 1326 (time 1763347089.46 total 20.01 last 64.06) - open/close 1977 (time 1763347099.46 total 30.02 last 65.06) - open/close 2675 (time 1763347109.47 total 40.02 last 69.78) - open/close 3212 (time 1763347119.48 total 50.03 last 53.64) - open/close 3804 (time 1763347129.48 total 60.03 last 59.20) - open/close 4472 (time 1763347139.48 total 70.04 last 66.78) - open/close 5099 (time 1763347149.50 total 80.05 last 62.61) - open/close 5764 (time 1763347159.50 total 90.06 last 66.44) - open/close 6418 (time 1763347169.52 total 100.07 last 65.32) - open/close 7079 (time 1763347179.54 total 110.09 last 65.96) - open/close 7745 (time 1763347189.55 total 120.10 last 66.52) - open/close 8398 (time 1763347199.57 total 130.12 last 65.18) - open/close 9094 (time 1763347209.58 total 140.14 last 69.50) - open/close 9796 (time 1763347219.59 total 150.15 last 70.11) total: 10000 open/close in 153.72 seconds: 65.05 ops/second - unlinked 0 (time 1763347228 ; total 0 ; last 0) total: 10000 unlinks in 93 seconds: 107.526878 unlinks/second - open/close 631 (time 1763347335.99 total 10.01 last 63.04) - open/close 1249 (time 1763347346.01 total 20.03 last 61.69) - open/close 1814 (time 1763347356.03 total 30.05 last 56.38) - open/close 2521 (time 1763347366.03 total 40.05 last 70.69) - open/close 3177 (time 1763347376.04 total 50.05 last 65.58) - open/close 3829 (time 1763347386.04 total 60.06 last 65.16) - open/close 4559 (time 1763347396.05 total 70.07 last 72.91) - open/close 5200 (time 1763347406.05 total 80.07 last 64.09) - open/close 5828 (time 1763347416.06 total 90.08 last 62.75) - open/close 6447 (time 1763347426.07 total 100.09 last 61.84) - open/close 7123 (time 1763347436.08 total 110.10 last 67.53) - open/close 7772 (time 1763347446.09 total 120.11 last 64.86) - open/close 8458 (time 1763347456.10 total 130.12 last 68.51) - open/close 9122 (time 1763347466.10 total 140.12 last 66.40) - open/close 9704 (time 1763347476.11 total 150.13 last 58.15) total: 10000 open/close in 154.71 seconds: 64.64 ops/second - unlinked 0 (time 1763347484 ; total 0 ; last 0) total: 10000 unlinks in 89 seconds: 112.359550 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg239-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg239-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg239-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.139@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.139@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg239-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-OST0000 oleg239-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg239-server: oleg239-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg239-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg239-client.virtnet: -o user_xattr,flock 192.168.202.139@tcp:/lustre /mnt/lustre On OST0, 20325 used inodes rc=0 pdsh@oleg239-client: oleg239-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg239-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg239-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg239-server Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.202.139@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.139@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.202.139@tcp autodegrade=on sys.timeout=20 Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.139@tcp autodegrade=on sys.timeout=20 autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.139@tcp lustre:autodegrade=on lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg239-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg239-server: oleg239-server.virtnet: executing set_default_debug -1 all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-OST0000 oleg239-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg239-server: oleg239-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg239-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg239-client.virtnet: -o user_xattr,flock 192.168.202.139@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg239-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg239-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg239-server stop mds service on oleg239-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg239-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg239-server' oleg239-server: oleg239-server.virtnet: executing unload_modules_local oleg239-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg239-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg239-client: oleg239-client: ssh exited with exit code 2 pdsh@oleg239-client: oleg239-server: ssh exited with exit code 2 pdsh@oleg239-client: oleg239-client: ssh exited with exit code 2 pdsh@oleg239-client: oleg239-server: ssh exited with exit code 2 PASS 69 (2705s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 21:48:24 (1763347704) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (3s) Stopping clients: oleg239-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg239-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg239-client: oleg239-server: ssh exited with exit code 2 oleg239-server: oleg239-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg239-server' oleg239-server: oleg239-server.virtnet: executing load_modules_local oleg239-server: Loading modules from /home/green/git/lustre-release/lustre oleg239-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg239-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg239-server: detected 4 online CPUs by sysfs oleg239-server: MODOPTS_LIBCFS= oleg239-server: Force libcfs to create 2 CPU partitions oleg239-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg239-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3100 sec ========== 21:49:29 (1763347769) === conf-sanity: start cleanup 21:49:31 (1763347771) === === conf-sanity: finish cleanup 21:49:33 (1763347773) ===