== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 09:05:01 (1747832701) Stopping clients: oleg223-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg223-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg223-client: oleg223-server: ssh exited with exit code 2 oleg223-server: oleg223-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg223-server' oleg223-server: oleg223-server.virtnet: executing load_modules_local oleg223-server: Loading modules from /home/green/git/lustre-release/lustre oleg223-server: detected 4 online CPUs by sysfs oleg223-server: Force libcfs to create 2 CPU partitions oleg223-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg223-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg223-server' oleg223-server: oleg223-server.virtnet: executing load_modules_local oleg223-server: Loading modules from /home/green/git/lustre-release/lustre oleg223-server: detected 4 online CPUs by sysfs oleg223-server: Force libcfs to create 2 CPU partitions oleg223-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg223-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory fail_loc=0x00001e0 start mds service on oleg223-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg223-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg223-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg223-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg223-client.virtnet: -o user_xattr,flock oleg223-server@tcp:/lustre /mnt/lustre obdfilter.lustre-OST0000.precreate_batch=256 fail_loc=0 On OST0, 49667 inodes available. Want 100500. rc=0 - open/close 1529 (time 1747832784.36 total 10.00 last 152.84) - open/close 2945 (time 1747832794.37 total 20.01 last 141.52) - open/close 4391 (time 1747832804.38 total 30.01 last 144.52) - open/close 5952 (time 1747832814.38 total 40.02 last 155.97) - open/close 7427 (time 1747832824.39 total 50.03 last 147.44) - open/close 8990 (time 1747832834.39 total 60.03 last 156.19) total: 10000 open/close in 66.75 seconds: 149.81 ops/second - unlinked 0 (time 1747832842 ; total 0 ; last 0) total: 10000 unlinks in 32 seconds: 312.500000 unlinks/second - open/close 1833 (time 1747832886.13 total 10.01 last 183.18) - open/close 3662 (time 1747832896.14 total 20.01 last 182.86) - open/close 5557 (time 1747832906.14 total 30.02 last 189.37) - open/close 7910 (time 1747832916.15 total 40.02 last 235.23) total: 10000 open/close in 49.92 seconds: 200.31 ops/second - unlinked 0 (time 1747832927 ; total 0 ; last 0) total: 10000 unlinks in 22 seconds: 454.545441 unlinks/second - open/close 2117 (time 1747832960.95 total 10.00 last 211.68) - open/close 4370 (time 1747832970.95 total 20.00 last 225.27) - open/close 6702 (time 1747832980.95 total 30.01 last 233.13) - open/close 8702 (time 1747832990.95 total 40.01 last 199.92) total: 10000 open/close in 47.21 seconds: 211.84 ops/second - unlinked 0 (time 1747832999 ; total 0 ; last 0) total: 10000 unlinks in 29 seconds: 344.827576 unlinks/second - open/close 2046 (time 1747833039.93 total 10.01 last 204.41) - open/close 3745 (time 1747833049.93 total 20.01 last 169.85) - open/close 5661 (time 1747833059.93 total 30.02 last 191.54) - open/close 7707 (time 1747833069.94 total 40.02 last 204.51) - open/close 9723 (time 1747833079.94 total 50.02 last 201.59) total: 10000 open/close in 51.20 seconds: 195.31 ops/second - unlinked 0 (time 1747833082 ; total 0 ; last 0) total: 10000 unlinks in 24 seconds: 416.666656 unlinks/second - open/close 2265 (time 1747833117.27 total 10.00 last 226.45) - open/close 4352 (time 1747833127.28 total 20.01 last 208.64) - open/close 6341 (time 1747833137.28 total 30.01 last 198.89) - open/close 8280 (time 1747833147.28 total 40.01 last 193.82) total: 10000 open/close in 48.80 seconds: 204.91 ops/second - unlinked 0 (time 1747833157 ; total 0 ; last 0) total: 10000 unlinks in 24 seconds: 416.666656 unlinks/second - open/close 2710 (time 1747833192.26 total 10.00 last 270.92) - open/close 5009 (time 1747833202.26 total 20.01 last 229.76) - open/close 7424 (time 1747833212.27 total 30.01 last 241.47) total: 10000 open/close in 39.98 seconds: 250.13 ops/second - unlinked 0 (time 1747833223 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2519 (time 1747833254.64 total 10.00 last 251.87) - open/close 4677 (time 1747833264.64 total 20.00 last 215.77) - open/close 6357 (time 1747833274.64 total 30.00 last 167.97) - open/close 8356 (time 1747833284.65 total 40.01 last 199.79) - open/close 9979 (time 1747833294.65 total 50.01 last 162.28) total: 10000 open/close in 50.13 seconds: 199.50 ops/second - unlinked 0 (time 1747833296 ; total 0 ; last 0) total: 10000 unlinks in 27 seconds: 370.370361 unlinks/second - open/close 2207 (time 1747833334.81 total 10.00 last 220.64) - open/close 4218 (time 1747833344.82 total 20.01 last 201.04) - open/close 6324 (time 1747833354.82 total 30.01 last 210.58) - open/close 8326 (time 1747833364.82 total 40.01 last 200.17) total: 10000 open/close in 48.33 seconds: 206.90 ops/second - unlinked 0 (time 1747833374 ; total 0 ; last 0) total: 10000 unlinks in 21 seconds: 476.190491 unlinks/second - open/close 2697 (time 1747833406.18 total 10.00 last 269.61) - open/close 5372 (time 1747833416.18 total 20.00 last 267.48) - open/close 7822 (time 1747833426.18 total 30.01 last 244.97) total: 10000 open/close in 38.57 seconds: 259.29 ops/second - unlinked 0 (time 1747833435 ; total 0 ; last 0) total: 10000 unlinks in 21 seconds: 476.190491 unlinks/second - open/close 2679 (time 1747833467.41 total 10.00 last 267.87) - open/close 5112 (time 1747833477.41 total 20.00 last 243.22) - open/close 7444 (time 1747833487.42 total 30.01 last 233.07) - open/close 9537 (time 1747833497.42 total 40.01 last 209.24) total: 10000 open/close in 41.85 seconds: 238.93 ops/second - unlinked 0 (time 1747833500 ; total 0 ; last 0) total: 10000 unlinks in 22 seconds: 454.545441 unlinks/second - open/close 2131 (time 1747833533.66 total 10.00 last 213.09) - open/close 4342 (time 1747833543.66 total 20.00 last 221.09) - open/close 6692 (time 1747833553.67 total 30.01 last 234.88) - open/close 8845 (time 1747833563.67 total 40.01 last 215.29) total: 10000 open/close in 44.46 seconds: 224.90 ops/second - unlinked 0 (time 1747833569 ; total 0 ; last 0) total: 10000 unlinks in 25 seconds: 400.000000 unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 95248 4144 82448 5% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 95248 1504 85088 2% /mnt/lustre[MDT:1] lustre-OST0000_UUID 142216 1644 126572 2% /mnt/lustre[OST:0] filesystem_summary: 142216 1644 126572 2% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11776 s, 8.9 MB/s fail_loc=0x80000204 Failing ost1 on oleg223-server Stopping /mnt/lustre-ost1 (opts:) on oleg223-server reboot facets: ost1 Failover ost1 to oleg223-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg223-server: oleg223-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg223-client: oleg223-server: ssh exited with exit code 1 Started lustre-OST0000 oleg223-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec - open/close 0 (time 1747833624.28 total 2.15 last 0.00) total: 100 open/close in 3.13 seconds: 31.93 ops/second umount lustre on /mnt/lustre..... Stopping client oleg223-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg223-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg223-server stop mds service on oleg223-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg223-server stop mds service on oleg223-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg223-server LNET ready to unload unloading modules on: 'oleg223-server' oleg223-server: oleg223-server.virtnet: executing unload_modules_local oleg223-server: LNET ready to unload modules unloaded.