lhsmtool_posix: 1762458505.286624 [101311]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762458505.309148 [101312]: waiting for message from kernel
lhsmtool_posix: 1762458505.353864 [101313]: freezing thread IOs
lhsmtool_posix: 1762458508.188992 [101312]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762458508.189954 [101412]: [0x200000403:0x165:0x0] action ARCHIVE reclen 72, cookie=0x690d8e75
lhsmtool_posix: 1762458508.191243 [101414]: [0x200000403:0x167:0x0] action ARCHIVE reclen 72, cookie=0x690d8e77
lhsmtool_posix: 1762458508.191525 [101415]: [0x200000403:0x168:0x0] action ARCHIVE reclen 72, cookie=0x690d8e78
lhsmtool_posix: 1762458508.191763 [101413]: [0x200000403:0x166:0x0] action ARCHIVE reclen 72, cookie=0x690d8e76
lhsmtool_posix: 1762458508.193528 [101416]: [0x200000403:0x169:0x0] action ARCHIVE reclen 72, cookie=0x690d8e79
lhsmtool_posix: 1762458508.195003 [101417]: [0x200000403:0x16a:0x0] action ARCHIVE reclen 72, cookie=0x690d8e7a
lhsmtool_posix: 1762458508.196688 [101312]: waiting for message from kernel
lhsmtool_posix: 1762458508.197002 [101421]: [0x200000403:0x16e:0x0] action ARCHIVE reclen 72, cookie=0x690d8e7e
lhsmtool_posix: 1762458508.197327 [101420]: [0x200000403:0x16d:0x0] action ARCHIVE reclen 72, cookie=0x690d8e7d
lhsmtool_posix: 1762458508.202070 [101418]: [0x200000403:0x16b:0x0] action ARCHIVE reclen 72, cookie=0x690d8e7b
lhsmtool_posix: 1762458508.202654 [101419]: [0x200000403:0x16c:0x0] action ARCHIVE reclen 72, cookie=0x690d8e7c
lhsmtool_posix: 1762458508.210588 [101416]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762458508.214777 [101412]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762458508.215381 [101417]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762458508.215920 [101415]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762458508.216499 [101419]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762458508.216884 [101413]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762458508.217997 [101418]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762458508.219318 [101414]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762458508.219568 [101421]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762458508.219742 [101420]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762458508.262833 [101412]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' to '/tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp'
lhsmtool_posix: 1762458508.264020 [101412]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' in /tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp.lov
lhsmtool_posix: 1762458508.280443 [101417]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' to '/tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp'
lhsmtool_posix: 1762458508.280614 [101417]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' in /tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp.lov
lhsmtool_posix: 1762458508.289981 [101419]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' to '/tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp'
lhsmtool_posix: 1762458508.290171 [101419]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' in /tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp.lov
lhsmtool_posix: 1762458508.292922 [101413]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' to '/tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp'
lhsmtool_posix: 1762458508.293024 [101415]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' to '/tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp'
lhsmtool_posix: lhsmtool_posix: 1762458508.293084 [101413]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' in /tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp.lov
1762458508.293090 [101415]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' in /tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp.lov
lhsmtool_posix: 1762458508.293940 [101412]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' to '/tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp'
lhsmtool_posix: 1762458508.299994 [101416]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' to '/tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp'
lhsmtool_posix: 1762458508.300157 [101416]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' in /tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp.lov
lhsmtool_posix: 1762458508.304024 [101421]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' to '/tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp'
lhsmtool_posix: 1762458508.304214 [101421]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' in /tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp.lov
lhsmtool_posix: 1762458508.305804 [101414]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' to '/tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp'
lhsmtool_posix: 1762458508.305925 [101414]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' in /tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp.lov
lhsmtool_posix: 1762458508.306322 [101417]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' to '/tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp'
lhsmtool_posix: 1762458508.315282 [101420]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' to '/tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp'
lhsmtool_posix: 1762458508.315461 [101420]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' in /tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp.lov
lhsmtool_posix: 1762458508.325564 [101418]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' to '/tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp'
lhsmtool_posix: 1762458508.325668 [101419]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' to '/tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp'
lhsmtool_posix: 1762458508.325745 [101418]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' in /tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp.lov
lhsmtool_posix: 1762458508.325792 [101416]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' to '/tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp'
lhsmtool_posix: 1762458508.326013 [101415]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' to '/tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp'
lhsmtool_posix: 1762458508.326585 [101413]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' to '/tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp'
lhsmtool_posix: 1762458508.332392 [101414]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' to '/tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp'
lhsmtool_posix: 1762458508.332533 [101421]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' to '/tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp'
lhsmtool_posix: 1762458508.338121 [101420]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' to '/tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp'
lhsmtool_posix: 1762458508.340080 [101418]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' to '/tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp'
lhsmtool_posix: 1762458516.256687 [101313]: canceling running request matching [0x200000403:0x165:0x0]
lhsmtool_posix: 1762458516.316703 [101412]: copied 1048576 bytes in 8.052462 seconds
lhsmtool_posix: 1762458516.316792 [101412]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' to '/tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458516.316959 [101412]: Action completed, notifying coordinator cookie=0x690d8e75, FID=[0x200000403:0x165:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458516.339164 [101412]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.092551 [101313]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762458517.319797 [101417]: copied 1048576 bytes in 9.039020 seconds
lhsmtool_posix: 1762458517.319862 [101417]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' to '/tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.319957 [101417]: Action completed, notifying coordinator cookie=0x690d8e7a, FID=[0x200000403:0x16a:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.333028 [101417]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.351454 [101421]: copied 1048576 bytes in 9.047064 seconds
lhsmtool_posix: 1762458517.351520 [101421]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' to '/tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.351621 [101421]: Action completed, notifying coordinator cookie=0x690d8e7e, FID=[0x200000403:0x16e:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.352306 [101415]: copied 1048576 bytes in 9.059013 seconds
lhsmtool_posix: 1762458517.352340 [101415]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' to '/tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.352401 [101415]: Action completed, notifying coordinator cookie=0x690d8e78, FID=[0x200000403:0x168:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.352919 [101414]: copied 1048576 bytes in 9.046873 seconds
lhsmtool_posix: 1762458517.352947 [101414]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' to '/tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.353007 [101414]: Action completed, notifying coordinator cookie=0x690d8e77, FID=[0x200000403:0x167:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.362046 [101416]: copied 1048576 bytes in 9.061704 seconds
lhsmtool_posix: 1762458517.362108 [101416]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' to '/tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.362242 [101416]: Action completed, notifying coordinator cookie=0x690d8e79, FID=[0x200000403:0x169:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.362925 [101419]: copied 1048576 bytes in 9.072575 seconds
lhsmtool_posix: 1762458517.362954 [101419]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' to '/tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.363012 [101419]: Action completed, notifying coordinator cookie=0x690d8e7c, FID=[0x200000403:0x16c:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.366064 [101413]: copied 1048576 bytes in 9.072814 seconds
lhsmtool_posix: 1762458517.366122 [101413]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' to '/tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.366652 [101420]: copied 1048576 bytes in 9.051038 seconds
lhsmtool_posix: 1762458517.366680 [101420]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' to '/tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.366749 [101420]: Action completed, notifying coordinator cookie=0x690d8e7d, FID=[0x200000403:0x16d:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.367293 [101413]: Action completed, notifying coordinator cookie=0x690d8e76, FID=[0x200000403:0x166:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.372298 [101418]: copied 1048576 bytes in 9.046395 seconds
lhsmtool_posix: 1762458517.372359 [101418]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' to '/tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762458517.372447 [101418]: Action completed, notifying coordinator cookie=0x690d8e7b, FID=[0x200000403:0x16b:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762458517.385312 [101416]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.385612 [101421]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.385782 [101419]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.386340 [101414]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.386704 [101415]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.394110 [101413]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.394805 [101420]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' ok (rc=0)
lhsmtool_posix: 1762458517.397023 [101418]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' ok (rc=0)
lhsmtool_posix: 1762458524.296478 [101313]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762458529.052969 [101312]: process finished, errs: 10 major, 0 minor, rc=0 (Success)