lhsmtool_posix: 1762455397.989122 [10827]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455398.047574 [10828]: waiting for message from kernel
lhsmtool_posix: 1762455398.092756 [10829]: freezing thread IOs
lhsmtool_posix: 1762455402.452659 [10828]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455402.453156 [10930]: [0x200000402:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cef47
lhsmtool_posix: 1762455402.453384 [10929]: [0x200000402:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cef46
lhsmtool_posix: 1762455402.453578 [10931]: [0x200000402:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cef48
lhsmtool_posix: 1762455402.455454 [10828]: waiting for message from kernel
lhsmtool_posix: 1762455402.455898 [10937]: [0x200000402:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cef4e
lhsmtool_posix: 1762455402.456190 [10936]: [0x200000402:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cef4d
lhsmtool_posix: 1762455402.456375 [10935]: [0x200000402:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cef4c
lhsmtool_posix: 1762455402.456538 [10934]: [0x200000402:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cef4b
lhsmtool_posix: 1762455402.456821 [10933]: [0x200000402:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cef4a
lhsmtool_posix: 1762455402.457827 [10932]: [0x200000402:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cef49
lhsmtool_posix: 1762455402.462386 [10938]: [0x200000402:0xd:0x0] action ARCHIVE reclen 72, cookie=0x690cef4f
lhsmtool_posix: 1762455402.474168 [10931]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455402.476919 [10937]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455402.477719 [10930]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455402.479507 [10932]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455402.480026 [10929]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455402.480370 [10938]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455402.480706 [10933]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455402.485345 [10936]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455402.485924 [10935]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455402.486074 [10934]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455402.537760 [10936]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp'
lhsmtool_posix: 1762455402.538018 [10936]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455402.559506 [10932]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'
lhsmtool_posix: 1762455402.559696 [10932]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455402.561804 [10930]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp'
lhsmtool_posix: 1762455402.561937 [10930]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455402.562508 [10933]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp'
lhsmtool_posix: 1762455402.562586 [10933]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455402.569577 [10935]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp'
lhsmtool_posix: 1762455402.569743 [10935]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455402.571838 [10936]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp'
lhsmtool_posix: 1762455402.571984 [10934]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp'
lhsmtool_posix: 1762455402.572098 [10934]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455402.573165 [10931]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp'
lhsmtool_posix: 1762455402.573322 [10931]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455402.573765 [10938]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp'
lhsmtool_posix: 1762455402.573877 [10938]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp.lov
lhsmtool_posix: 1762455402.575644 [10933]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp'
lhsmtool_posix: 1762455402.576980 [10929]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp'
lhsmtool_posix: 1762455402.578895 [10930]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp'
lhsmtool_posix: 1762455402.579628 [10929]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455402.586552 [10934]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp'
lhsmtool_posix: 1762455402.586666 [10931]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp'
lhsmtool_posix: 1762455402.586762 [10932]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp'
lhsmtool_posix: 1762455402.586915 [10938]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp'
lhsmtool_posix: 1762455402.588581 [10937]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp'
lhsmtool_posix: 1762455402.588714 [10937]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455402.591676 [10935]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp'
lhsmtool_posix: 1762455402.593176 [10929]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp'
lhsmtool_posix: 1762455402.597405 [10937]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp'
lhsmtool_posix: 1762455411.403527 [10829]: canceling running request matching [0x200000402:0x4:0x0]
lhsmtool_posix: 1762455411.619841 [10929]: copied 1048576 bytes in 9.037835 seconds
lhsmtool_posix: 1762455411.619982 [10929]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455411.620098 [10929]: Action completed, notifying coordinator cookie=0x690cef46, FID=[0x200000402:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455411.643924 [10929]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.261753 [10829]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455412.610839 [10930]: copied 1048576 bytes in 10.048772 seconds
lhsmtool_posix: 1762455412.610924 [10930]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.611040 [10930]: Action completed, notifying coordinator cookie=0x690cef47, FID=[0x200000402:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.613811 [10937]: copied 1048576 bytes in 10.024937 seconds
lhsmtool_posix: 1762455412.613880 [10937]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.613975 [10937]: Action completed, notifying coordinator cookie=0x690cef4e, FID=[0x200000402:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.614486 [10935]: copied 1048576 bytes in 10.044500 seconds
lhsmtool_posix: 1762455412.614517 [10935]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.614582 [10935]: Action completed, notifying coordinator cookie=0x690cef4c, FID=[0x200000402:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.617601 [10934]: copied 1048576 bytes in 10.045339 seconds
lhsmtool_posix: 1762455412.617662 [10934]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.617803 [10934]: Action completed, notifying coordinator cookie=0x690cef4b, FID=[0x200000402:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.622014 [10933]: copied 1048576 bytes in 10.059314 seconds
lhsmtool_posix: 1762455412.622081 [10933]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.622190 [10933]: Action completed, notifying coordinator cookie=0x690cef4a, FID=[0x200000402:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.623236 [10938]: copied 1048576 bytes in 10.049263 seconds
lhsmtool_posix: 1762455412.623270 [10938]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.623332 [10938]: Action completed, notifying coordinator cookie=0x690cef4f, FID=[0x200000402:0xd:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.626589 [10932]: copied 1048576 bytes in 10.066705 seconds
lhsmtool_posix: 1762455412.626652 [10932]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.626747 [10932]: Action completed, notifying coordinator cookie=0x690cef49, FID=[0x200000402:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.634041 [10931]: copied 1048576 bytes in 10.060574 seconds
lhsmtool_posix: 1762455412.634116 [10931]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.634217 [10931]: Action completed, notifying coordinator cookie=0x690cef48, FID=[0x200000402:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.636913 [10936]: copied 1048576 bytes in 10.098747 seconds
lhsmtool_posix: 1762455412.636987 [10936]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455412.637136 [10936]: Action completed, notifying coordinator cookie=0x690cef4d, FID=[0x200000402:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455412.653103 [10937]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.656254 [10930]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.665674 [10933]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.666076 [10934]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.666860 [10935]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.667102 [10932]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.667493 [10938]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.689222 [10931]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455412.689913 [10936]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455421.084843 [10829]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455425.447845 [10828]: process finished, errs: 10 major, 0 minor, rc=0 (Success)