== sanity test 116a: stripe QOS: free space balance ============================================================================= 00:55:15 (1735365315) Free space priority 90% oleg406-server: error: set_param: setting /sys/fs/lustre/osc/lustre-OST0000-osc-MDT0000/force_sync=1: Connection timed out oleg406-server: error: set_param: setting 'os[cd]*/*MD*/force_sync'='1': Connection timed out pdsh@oleg406-client: oleg406-server: ssh exited with exit code 110 Delete is not completed in 49 seconds osc.lustre-OST0000-osc-MDT0000.sync_changes=285 osc.lustre-OST0000-osc-MDT0000.sync_in_flight=8 osc.lustre-OST0000-osc-MDT0000.sync_in_progress=8 osc.lustre-OST0000-osc-MDT0001.sync_changes=0 osc.lustre-OST0000-osc-MDT0001.sync_in_flight=0 osc.lustre-OST0000-osc-MDT0001.sync_in_progress=0 osc.lustre-OST0001-osc-MDT0000.sync_changes=0 osc.lustre-OST0001-osc-MDT0000.sync_in_flight=0 osc.lustre-OST0001-osc-MDT0000.sync_in_progress=0 osc.lustre-OST0001-osc-MDT0001.sync_changes=0 osc.lustre-OST0001-osc-MDT0001.sync_in_flight=0 osc.lustre-OST0001-osc-MDT0001.sync_in_progress=0 OST kbytes available: 3604308 3605448 Min free space: OST 0: 3604308 Max free space: OST 1: 3605448 striped dir -i0 -c2 -H crush /mnt/lustre/d116a.sanity/OST0 Check for uneven OSTs: diff=1140KB (0%) must be > 17% ...no Fill 19% remaining space in OST0 with 684818KB ............................................................................................................................................................................................................................................................................................................................................... Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 OST kbytes available: 2922324 3605448 Min free space: OST 0: 2922324 Max free space: OST 1: 3605448 diff=683124=23% must be > 17% for QOS mode...ok writing 600 files to QOS-assigned OSTs ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................wrote 600 200k files Note: free space may not be updated, so measurements might be off Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 OST kbytes available: 2869324 3538448 Min free space: OST 0: 2869324 Max free space: OST 1: 3538448 free space delta: orig 683124 final 669124 Wrote 53000KB to smaller OST 0 Wrote 67000KB to larger OST 1 Wrote 26% more data to larger OST 1 lustre-OST0000_UUID 265 files created on smaller OST 0 lustre-OST0001_UUID 335 files created on larger OST 1 Wrote 26% more files to larger OST 1 Waiting for MDT destroys to complete oleg406-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg406-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 pdsh@oleg406-client: oleg406-server: ssh exited with exit code 1 cleanup time 32