lhsmtool_posix: 1762455618.185266 [11828]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455618.223528 [11829]: waiting for message from kernel lhsmtool_posix: 1762455618.268665 [11830]: freezing thread IOs lhsmtool_posix: 1762455623.097004 [11829]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455623.097329 [11931]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cf01f lhsmtool_posix: 1762455623.097633 [11932]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cf020 lhsmtool_posix: 1762455623.109746 [11933]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cf021 lhsmtool_posix: 1762455623.110106 [11931]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455623.110135 [11932]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455623.110588 [11934]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cf022 lhsmtool_posix: 1762455623.111370 [11829]: waiting for message from kernel lhsmtool_posix: 1762455623.111413 [11939]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cf027 lhsmtool_posix: 1762455623.111661 [11940]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cf028 lhsmtool_posix: 1762455623.110716 [11937]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cf025 lhsmtool_posix: 1762455623.110682 [11938]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cf026 lhsmtool_posix: 1762455623.110734 [11935]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cf023 lhsmtool_posix: 1762455623.117657 [11933]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455623.110693 [11936]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cf024 lhsmtool_posix: 1762455623.118676 [11939]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455623.131566 [11940]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455623.133338 [11937]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455623.138232 [11934]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455623.140408 [11936]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455623.141304 [11938]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455623.160773 [11935]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455623.179943 [11932]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455623.180094 [11932]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov lhsmtool_posix: 1762455623.216369 [11939]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455623.216500 [11939]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov lhsmtool_posix: 1762455623.221547 [11931]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455623.221708 [11931]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov lhsmtool_posix: 1762455623.237836 [11933]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455623.238000 [11933]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov lhsmtool_posix: 1762455623.255751 [11938]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455623.255893 [11938]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov lhsmtool_posix: 1762455623.262123 [11936]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455623.262239 [11936]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov lhsmtool_posix: 1762455623.263230 [11934]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455623.263336 [11934]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov lhsmtool_posix: 1762455623.268972 [11939]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455623.269119 [11932]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455623.270889 [11931]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455623.279415 [11933]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455623.279602 [11940]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455623.279796 [11940]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov lhsmtool_posix: 1762455623.282937 [11937]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455623.283096 [11937]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov lhsmtool_posix: 1762455623.292561 [11934]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455623.303987 [11938]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455623.304169 [11935]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455623.304284 [11935]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov lhsmtool_posix: 1762455623.305011 [11936]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455623.305100 [11940]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455623.310382 [11937]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455623.323606 [11935]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455633.005305 [11830]: canceling running request matching [0x200000403:0x3:0x0] lhsmtool_posix: 1762455633.291701 [11931]: copied 1048576 bytes in 10.069846 seconds lhsmtool_posix: 1762455633.291757 [11931]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455633.291897 [11931]: Action completed, notifying coordinator cookie=0x690cf01f, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455633.307301 [11931]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0) lhsmtool_posix: 1762455633.946133 [11830]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455634.299128 [11939]: copied 1048576 bytes in 11.082461 seconds lhsmtool_posix: 1762455634.299216 [11939]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.299356 [11939]: Action completed, notifying coordinator cookie=0x690cf027, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.310976 [11939]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455634.314110 [11934]: copied 1048576 bytes in 11.050662 seconds lhsmtool_posix: 1762455634.314182 [11934]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.314294 [11934]: Action completed, notifying coordinator cookie=0x690cf022, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.314584 [11932]: copied 1048576 bytes in 11.134359 seconds lhsmtool_posix: 1762455634.314611 [11932]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.314693 [11932]: Action completed, notifying coordinator cookie=0x690cf020, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.317713 [11933]: copied 1048576 bytes in 11.079581 seconds lhsmtool_posix: 1762455634.317791 [11933]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.317873 [11933]: Action completed, notifying coordinator cookie=0x690cf021, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.322339 [11936]: copied 1048576 bytes in 11.059973 seconds lhsmtool_posix: 1762455634.322413 [11936]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.322541 [11936]: Action completed, notifying coordinator cookie=0x690cf024, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.331002 [11938]: copied 1048576 bytes in 11.073794 seconds lhsmtool_posix: 1762455634.331076 [11938]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.331183 [11938]: Action completed, notifying coordinator cookie=0x690cf026, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.332939 [11940]: copied 1048576 bytes in 11.052984 seconds lhsmtool_posix: 1762455634.333000 [11940]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.333095 [11940]: Action completed, notifying coordinator cookie=0x690cf028, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.341935 [11937]: copied 1048576 bytes in 11.058711 seconds lhsmtool_posix: 1762455634.342025 [11937]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.342164 [11937]: Action completed, notifying coordinator cookie=0x690cf025, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.346325 [11932]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455634.350212 [11934]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455634.358466 [11935]: copied 1048576 bytes in 11.054049 seconds lhsmtool_posix: 1762455634.358559 [11935]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455634.359744 [11935]: Action completed, notifying coordinator cookie=0x690cf023, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455634.360582 [11938]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455634.365586 [11936]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0) lhsmtool_posix: 1762455634.365937 [11940]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455634.368606 [11933]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0) lhsmtool_posix: 1762455634.382168 [11937]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0) lhsmtool_posix: 1762455634.381973 [11935]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455643.053368 [11830]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455649.521119 [11829]: process finished, errs: 10 major, 0 minor, rc=0 (Success)