== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 18:46:47 (1736984807) Stopping clients: oleg429-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg429-client.virtnet /mnt/lustre2 (opts:-f) oleg429-server: oleg429-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg429-server' oleg429-server: oleg429-server.virtnet: executing load_modules_local oleg429-server: Loading modules from /home/green/git/lustre-release/lustre oleg429-server: detected 4 online CPUs by sysfs oleg429-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg429-server' oleg429-server: oleg429-server.virtnet: executing load_modules_local oleg429-server: Loading modules from /home/green/git/lustre-release/lustre oleg429-server: detected 4 online CPUs by sysfs oleg429-server: Force libcfs to create 2 CPU partitions fail_loc=0x00001e0 start mds service on oleg429-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg429-server: oleg429-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg429-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg429-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg429-server: oleg429-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg429-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg429-client.virtnet: -o user_xattr,flock oleg429-server@tcp:/lustre /mnt/lustre obdfilter.lustre-OST0000.precreate_batch=256 fail_loc=0 On OST0, 11872 inodes available. Want 100500. rc=0 - open/close 1392 (time 1736984872.65 total 10.00 last 139.17) - open/close 2526 (time 1736984882.66 total 20.01 last 113.34) - open/close 3889 (time 1736984892.66 total 30.01 last 136.30) - open/close 5654 (time 1736984902.66 total 40.01 last 176.47) - open/close 7185 (time 1736984912.66 total 50.01 last 153.07) - open/close 8471 (time 1736984922.66 total 60.01 last 128.57) - open/close 9940 (time 1736984932.67 total 70.02 last 146.78) total: 10000 open/close in 70.50 seconds: 141.85 ops/second - unlinked 0 (time 1736984934 ; total 0 ; last 0) total: 10000 unlinks in 38 seconds: 263.157898 unlinks/second - open/close 1352 (time 1736984984.30 total 10.00 last 135.14) - open/close 2678 (time 1736984994.31 total 20.01 last 132.57) - open/close 4022 (time 1736985004.31 total 30.01 last 134.34) - open/close 5552 (time 1736985014.32 total 40.01 last 152.94) - open/close 7046 (time 1736985024.32 total 50.02 last 149.26) - open/close 8468 (time 1736985034.33 total 60.03 last 142.18) - open/close 9974 (time 1736985044.33 total 70.03 last 150.54) total: 10000 open/close in 70.19 seconds: 142.48 ops/second - unlinked 0 (time 1736985045 ; total 0 ; last 0) total: 10000 unlinks in 32 seconds: 312.500000 unlinks/second - open/close 1728 (time 1736985088.71 total 10.00 last 172.78) - open/close 3716 (time 1736985098.71 total 20.00 last 198.79) - open/close 5525 (time 1736985108.72 total 30.01 last 180.81) - open/close 7435 (time 1736985118.72 total 40.01 last 190.92) - open/close 9249 (time 1736985128.72 total 50.01 last 181.38) total: 10000 open/close in 54.46 seconds: 183.62 ops/second - unlinked 0 (time 1736985134 ; total 0 ; last 0) total: 10000 unlinks in 37 seconds: 270.270264 unlinks/second - open/close 1522 (time 1736985182.69 total 10.01 last 152.12) - open/close 3363 (time 1736985192.70 total 20.01 last 184.06) - open/close 5317 (time 1736985202.70 total 30.01 last 195.35) - open/close 6956 (time 1736985212.70 total 40.01 last 163.84) - open/close 8687 (time 1736985222.70 total 50.02 last 173.08) total: 10000 open/close in 57.98 seconds: 172.47 ops/second - unlinked 0 (time 1736985232 ; total 0 ; last 0) total: 10000 unlinks in 28 seconds: 357.142853 unlinks/second - open/close 2101 (time 1736985271.55 total 10.00 last 210.06) - open/close 4091 (time 1736985281.56 total 20.01 last 198.83) - open/close 5909 (time 1736985291.56 total 30.01 last 181.74) - open/close 7661 (time 1736985301.56 total 40.01 last 175.19) - open/close 9620 (time 1736985311.57 total 50.02 last 195.77) total: 10000 open/close in 51.86 seconds: 192.83 ops/second - unlinked 0 (time 1736985314 ; total 0 ; last 0) total: 10000 unlinks in 32 seconds: 312.500000 unlinks/second - open/close 1985 (time 1736985357.83 total 10.00 last 198.46) - open/close 3781 (time 1736985367.84 total 20.01 last 179.45) - open/close 5498 (time 1736985377.84 total 30.01 last 171.65) - open/close 7028 (time 1736985387.85 total 40.02 last 152.94) - open/close 8741 (time 1736985397.85 total 50.02 last 171.24) total: 10000 open/close in 56.38 seconds: 177.35 ops/second - unlinked 0 (time 1736985405 ; total 0 ; last 0) total: 10000 unlinks in 25 seconds: 400.000000 unlinks/second - open/close 2533 (time 1736985441.46 total 10.00 last 253.22) - open/close 5013 (time 1736985451.46 total 20.01 last 247.92) - open/close 7394 (time 1736985461.47 total 30.02 last 237.85) - open/close 9598 (time 1736985471.48 total 40.02 last 220.37) total: 10000 open/close in 41.58 seconds: 240.52 ops/second - unlinked 0 (time 1736985474 ; total 0 ; last 0) total: 10000 unlinks in 16 seconds: 625.000000 unlinks/second - open/close 2877 (time 1736985501.86 total 10.00 last 287.67) - open/close 5753 (time 1736985511.86 total 20.00 last 287.59) - open/close 8339 (time 1736985521.86 total 30.00 last 258.59) total: 10000 open/close in 35.37 seconds: 282.76 ops/second - unlinked 0 (time 1736985528 ; total 0 ; last 0) total: 10000 unlinks in 17 seconds: 588.235291 unlinks/second - open/close 3111 (time 1736985556.58 total 10.00 last 311.01) - open/close 5885 (time 1736985566.58 total 20.00 last 277.36) - open/close 8701 (time 1736985576.58 total 30.01 last 281.54) total: 10000 open/close in 35.09 seconds: 285.00 ops/second - unlinked 0 (time 1736985582 ; total 0 ; last 0) total: 10000 unlinks in 17 seconds: 588.235291 unlinks/second - open/close 3003 (time 1736985610.42 total 10.00 last 300.26) - open/close 5841 (time 1736985620.42 total 20.00 last 283.76) - open/close 8223 (time 1736985630.43 total 30.01 last 238.13) total: 10000 open/close in 37.38 seconds: 267.53 ops/second - unlinked 0 (time 1736985638 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 3154 (time 1736985670.05 total 10.00 last 315.35) - open/close 6193 (time 1736985680.06 total 20.00 last 303.83) - open/close 9013 (time 1736985690.06 total 30.00 last 281.98) total: 10000 open/close in 33.11 seconds: 302.06 ops/second - unlinked 0 (time 1736985694 ; total 0 ; last 0) total: 10000 unlinks in 17 seconds: 588.235291 unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 6016 375552 2% /mnt/lustre[MDT:0] lustre-OST0000_UUID 382976 4096 376832 2% /mnt/lustre[OST:0] filesystem_summary: 382976 4096 376832 2% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.225317 s, 4.7 MB/s fail_loc=0x80000204 Failing ost1 on oleg429-server Stopping /mnt/lustre-ost1 (opts:) on oleg429-server reboot facets: ost1 Failover ost1 to oleg429-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg429-server: oleg429-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1 Started lustre-OST0000 oleg429-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec - open/close 0 (time 1736985741.57 total 4.91 last 0.00) total: 100 open/close in 5.60 seconds: 17.86 ops/second umount lustre on /mnt/lustre..... Stopping client oleg429-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg429-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg429-server stop mds service on oleg429-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg429-server LNET ready to unload unloading modules on: 'oleg429-server' oleg429-server: oleg429-server.virtnet: executing unload_modules_local oleg429-server: LNET ready to unload modules unloaded.