== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 23:45:57 (1722483957) Stopping clients: oleg151-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg151-client.virtnet /mnt/lustre2 (opts:-f) oleg151-server: oleg151-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg151-server' oleg151-server: oleg151-server.virtnet: executing load_modules_local oleg151-server: Loading modules from /home/green/git/lustre-release/lustre oleg151-server: detected 4 online CPUs by sysfs oleg151-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg151-server' oleg151-server: oleg151-server.virtnet: executing load_modules_local oleg151-server: Loading modules from /home/green/git/lustre-release/lustre oleg151-server: detected 4 online CPUs by sysfs oleg151-server: Force libcfs to create 2 CPU partitions fail_loc=0x00001e0 start mds service on oleg151-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg151-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg151-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg151-client.virtnet: -o user_xattr,flock oleg151-server@tcp:/lustre /mnt/lustre obdfilter.lustre-OST0000.precreate_batch=256 fail_loc=0 On OST0, 11872 inodes available. Want 100500. rc=0 - open/close 2841 (time 1722484009.64 total 10.00 last 284.06) - open/close 5589 (time 1722484019.64 total 20.00 last 274.78) - open/close 8352 (time 1722484029.64 total 30.00 last 276.26) total: 10000 open/close in 36.14 seconds: 276.68 ops/second - unlinked 0 (time 1722484036 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2573 (time 1722484067.78 total 10.00 last 257.26) - open/close 5772 (time 1722484077.78 total 20.00 last 319.84) - open/close 8447 (time 1722484087.79 total 30.01 last 267.42) total: 10000 open/close in 36.14 seconds: 276.68 ops/second - unlinked 0 (time 1722484095 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2901 (time 1722484126.36 total 10.00 last 290.04) - open/close 5447 (time 1722484136.36 total 20.01 last 254.49) - open/close 7997 (time 1722484146.37 total 30.01 last 254.90) total: 10000 open/close in 37.87 seconds: 264.08 ops/second - unlinked 0 (time 1722484155 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2805 (time 1722484186.89 total 10.00 last 280.45) - open/close 5329 (time 1722484196.90 total 20.00 last 252.36) - open/close 8060 (time 1722484206.90 total 30.00 last 273.10) total: 10000 open/close in 35.90 seconds: 278.57 ops/second - unlinked 0 (time 1722484214 ; total 0 ; last 0) total: 10000 unlinks in 18 seconds: 555.555542 unlinks/second - open/close 2565 (time 1722484243.41 total 10.00 last 256.41) - open/close 5258 (time 1722484253.42 total 20.01 last 269.24) - open/close 8029 (time 1722484263.42 total 30.01 last 277.02) total: 10000 open/close in 36.58 seconds: 273.36 ops/second - unlinked 0 (time 1722484271 ; total 0 ; last 0) total: 10000 unlinks in 18 seconds: 555.555542 unlinks/second - open/close 2646 (time 1722484300.26 total 10.00 last 264.50) - open/close 5530 (time 1722484310.26 total 20.00 last 288.38) - open/close 8499 (time 1722484320.26 total 30.01 last 296.81) total: 10000 open/close in 34.42 seconds: 290.57 ops/second - unlinked 0 (time 1722484325 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2682 (time 1722484356.29 total 10.00 last 268.12) - open/close 5281 (time 1722484366.29 total 20.00 last 259.87) - open/close 7837 (time 1722484376.30 total 30.01 last 255.56) total: 10000 open/close in 38.49 seconds: 259.84 ops/second - unlinked 0 (time 1722484386 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2615 (time 1722484417.89 total 10.00 last 261.43) - open/close 5141 (time 1722484427.89 total 20.00 last 252.57) - open/close 7656 (time 1722484437.90 total 30.01 last 251.43) total: 10000 open/close in 39.44 seconds: 253.54 ops/second - unlinked 0 (time 1722484448 ; total 0 ; last 0) total: 10000 unlinks in 21 seconds: 476.190491 unlinks/second - open/close 2624 (time 1722484480.23 total 10.00 last 262.36) - open/close 5175 (time 1722484490.24 total 20.00 last 255.03) - open/close 7696 (time 1722484500.24 total 30.01 last 252.01) total: 10000 open/close in 39.07 seconds: 255.95 ops/second - unlinked 0 (time 1722484510 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2786 (time 1722484541.75 total 10.00 last 278.59) - open/close 5401 (time 1722484551.75 total 20.00 last 261.42) - open/close 8189 (time 1722484561.76 total 30.01 last 278.70) total: 10000 open/close in 37.20 seconds: 268.79 ops/second - unlinked 0 (time 1722484570 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second - open/close 2641 (time 1722484601.55 total 10.00 last 264.10) - open/close 5295 (time 1722484611.55 total 20.00 last 265.37) - open/close 7978 (time 1722484621.56 total 30.01 last 268.17) total: 10000 open/close in 37.23 seconds: 268.63 ops/second - unlinked 0 (time 1722484630 ; total 0 ; last 0) total: 10000 unlinks in 20 seconds: 500.000000 unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 6016 375552 2% /mnt/lustre[MDT:0] lustre-OST0000_UUID 382976 3072 377856 1% /mnt/lustre[OST:0] filesystem_summary: 382976 3072 377856 1% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147028 s, 7.1 MB/s fail_loc=0x80000204 Failing ost1 on oleg151-server Stopping /mnt/lustre-ost1 (opts:) on oleg151-server reboot facets: ost1 Failover ost1 to oleg151-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg151-server: oleg151-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg151-client: oleg151-server: ssh exited with exit code 1 Started lustre-OST0000 oleg151-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec - open/close 0 (time 1722484675.57 total 2.20 last 0.00) total: 100 open/close in 3.01 seconds: 33.23 ops/second umount lustre on /mnt/lustre..... Stopping client oleg151-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg151-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg151-server stop mds service on oleg151-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg151-server LNET ready to unload unloading modules on: 'oleg151-server' oleg151-server: oleg151-server.virtnet: executing unload_modules_local oleg151-server: LNET ready to unload modules unloaded.