== sanity test 116a: stripe QOS: free space balance ============================================================================= 01:13:45 (1726118025) Free space priority 90% oleg217-server: error: set_param: setting /sys/fs/lustre/osc/lustre-OST0000-osc-MDT0000/force_sync=1: Connection timed out oleg217-server: error: set_param: setting 'os[cd]*/*MD*/force_sync'='1': Connection timed out pdsh@oleg217-client: oleg217-server: ssh exited with exit code 110 Delete is not completed in 49 seconds osc.lustre-OST0000-osc-MDT0000.sync_changes=0 osc.lustre-OST0000-osc-MDT0000.sync_in_flight=0 osc.lustre-OST0000-osc-MDT0000.sync_in_progress=0 osc.lustre-OST0001-osc-MDT0000.sync_changes=0 osc.lustre-OST0001-osc-MDT0000.sync_in_flight=0 osc.lustre-OST0001-osc-MDT0000.sync_in_progress=0 OST kbytes available: 3765248 3766272 Min free space: OST 0: 3765248 Max free space: OST 1: 3766272 Check for uneven OSTs: diff=1024KB (0%) must be > 17% ...no Fill 19% remaining space in OST0 with 715397KB .............................................................................................................................................................................................................................................................................................................................................................. sleep 5 for ZFS zfs Waiting for MDT destroys to complete OST kbytes available: 3047424 3766272 Min free space: OST 0: 3047424 Max free space: OST 1: 3766272 diff=718848=23% must be > 17% for QOS mode...ok writing 600 files to QOS-assigned OSTs ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................wrote 600 200k files Note: free space may not be updated, so measurements might be off sleep 5 for ZFS zfs Waiting for MDT destroys to complete OST kbytes available: 2974720 3686400 Min free space: OST 0: 2974720 Max free space: OST 1: 3686400 free space delta: orig 718848 final 711680 Wrote 72704KB to smaller OST 0 Wrote 79872KB to larger OST 1 Wrote 9% more data to larger OST 1 lustre-OST0000_UUID 289 files created on smaller OST 0 lustre-OST0001_UUID 311 files created on larger OST 1 Wrote 7% more files to larger OST 1 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cleanup time 42