lhsmtool_posix: 1762458732.460874 [101533]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762458732.499261 [101534]: waiting for message from kernel lhsmtool_posix: 1762458732.541775 [101535]: freezing thread IOs lhsmtool_posix: 1762458735.625376 [101534]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762458735.626653 [101534]: waiting for message from kernel lhsmtool_posix: 1762458735.627047 [101638]: [0x200000403:0x16c:0x0] action ARCHIVE reclen 72, cookie=0x690d8e93 lhsmtool_posix: 1762458735.627227 [101639]: [0x200000403:0x16d:0x0] action ARCHIVE reclen 72, cookie=0x690d8e94 lhsmtool_posix: 1762458735.627435 [101632]: [0x200000403:0x166:0x0] action ARCHIVE reclen 72, cookie=0x690d8e8d lhsmtool_posix: 1762458735.627838 [101636]: [0x200000403:0x16a:0x0] action ARCHIVE reclen 72, cookie=0x690d8e91 lhsmtool_posix: 1762458735.628090 [101635]: [0x200000403:0x169:0x0] action ARCHIVE reclen 72, cookie=0x690d8e90 lhsmtool_posix: 1762458735.628274 [101633]: [0x200000403:0x167:0x0] action ARCHIVE reclen 72, cookie=0x690d8e8e lhsmtool_posix: 1762458735.628464 [101637]: [0x200000403:0x16b:0x0] action ARCHIVE reclen 72, cookie=0x690d8e92 lhsmtool_posix: 1762458735.627247 [101634]: [0x200000403:0x168:0x0] action ARCHIVE reclen 72, cookie=0x690d8e8f lhsmtool_posix: 1762458735.632829 [101640]: [0x200000403:0x16e:0x0] action ARCHIVE reclen 72, cookie=0x690d8e95 lhsmtool_posix: 1762458735.641057 [101636]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762458735.641207 [101635]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762458735.629316 [101631]: [0x200000403:0x165:0x0] action ARCHIVE reclen 72, cookie=0x690d8e8c lhsmtool_posix: 1762458735.642162 [101632]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762458735.642228 [101633]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762458735.642890 [101637]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762458735.651841 [101640]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762458735.653368 [101638]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762458735.657686 [101639]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762458735.658078 [101631]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762458735.658191 [101634]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762458735.721132 [101636]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' to '/tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp' lhsmtool_posix: 1762458735.721355 [101636]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' in /tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp.lov lhsmtool_posix: 1762458735.725755 [101637]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' to '/tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp' lhsmtool_posix: 1762458735.725970 [101637]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' in /tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp.lov lhsmtool_posix: 1762458735.738626 [101633]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' to '/tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp' lhsmtool_posix: 1762458735.738843 [101633]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' in /tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp.lov lhsmtool_posix: 1762458735.752108 [101631]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' to '/tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp' lhsmtool_posix: 1762458735.752341 [101631]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' in /tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp.lov lhsmtool_posix: 1762458735.752994 [101640]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' to '/tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp' lhsmtool_posix: 1762458735.753097 [101640]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' in /tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp.lov lhsmtool_posix: 1762458735.753510 [101635]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' to '/tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp' lhsmtool_posix: 1762458735.753589 [101635]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' in /tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp.lov lhsmtool_posix: 1762458735.754436 [101637]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' to '/tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp' lhsmtool_posix: 1762458735.755029 [101632]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' to '/tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp' lhsmtool_posix: 1762458735.755438 [101632]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' in /tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp.lov lhsmtool_posix: 1762458735.757265 [101634]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' to '/tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp' lhsmtool_posix: 1762458735.757405 [101634]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' in /tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp.lov lhsmtool_posix: 1762458735.758478 [101636]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' to '/tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp' lhsmtool_posix: 1762458735.764780 [101633]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' to '/tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp' lhsmtool_posix: 1762458735.773965 [101631]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' to '/tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp' lhsmtool_posix: 1762458735.774029 [101638]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' to '/tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp' lhsmtool_posix: 1762458735.774143 [101640]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' to '/tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp' lhsmtool_posix: 1762458735.774202 [101638]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' in /tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp.lov lhsmtool_posix: 1762458735.774283 [101635]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' to '/tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp' lhsmtool_posix: 1762458735.774446 [101639]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' to '/tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp' lhsmtool_posix: 1762458735.774563 [101639]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' in /tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp.lov lhsmtool_posix: 1762458735.788652 [101632]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' to '/tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp' lhsmtool_posix: 1762458735.790344 [101634]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' to '/tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp' lhsmtool_posix: 1762458735.792640 [101639]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' to '/tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp' lhsmtool_posix: 1762458735.793719 [101638]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' to '/tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp' lhsmtool_posix: 1762458744.879538 [101535]: canceling running request matching [0x200000403:0x165:0x0] lhsmtool_posix: 1762458745.293219 [101631]: copied 1048576 bytes in 9.540700 seconds lhsmtool_posix: 1762458745.293294 [101631]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' to '/tmp/arc1/sanity-hsm.test_204//0566/0x200000403:0x165:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.293462 [101631]: Action completed, notifying coordinator cookie=0x690d8e8c, FID=[0x200000403:0x165:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.303323 [101631]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x165:0x0' ok (rc=0) lhsmtool_posix: 1762458745.753180 [101535]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762458745.784575 [101636]: copied 1048576 bytes in 10.063050 seconds lhsmtool_posix: 1762458745.784663 [101636]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' to '/tmp/arc1/sanity-hsm.test_204//0569/0x200000403:0x16a:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.784811 [101636]: Action completed, notifying coordinator cookie=0x690d8e91, FID=[0x200000403:0x16a:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.796973 [101637]: copied 1048576 bytes in 10.070848 seconds lhsmtool_posix: 1762458745.797050 [101637]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' to '/tmp/arc1/sanity-hsm.test_204//0568/0x200000403:0x16b:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.797165 [101637]: Action completed, notifying coordinator cookie=0x690d8e92, FID=[0x200000403:0x16b:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.803471 [101635]: copied 1048576 bytes in 10.049784 seconds lhsmtool_posix: 1762458745.803567 [101635]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' to '/tmp/arc1/sanity-hsm.test_204//056a/0x200000403:0x169:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.803742 [101635]: Action completed, notifying coordinator cookie=0x690d8e90, FID=[0x200000403:0x169:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.810980 [101639]: copied 1048576 bytes in 10.036255 seconds lhsmtool_posix: 1762458745.811069 [101639]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' to '/tmp/arc1/sanity-hsm.test_204//056e/0x200000403:0x16d:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.811191 [101639]: Action completed, notifying coordinator cookie=0x690d8e94, FID=[0x200000403:0x16d:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.811528 [101632]: copied 1048576 bytes in 10.055947 seconds lhsmtool_posix: 1762458745.811554 [101632]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' to '/tmp/arc1/sanity-hsm.test_204//0565/0x200000403:0x166:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.811611 [101632]: Action completed, notifying coordinator cookie=0x690d8e8d, FID=[0x200000403:0x166:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.813807 [101633]: copied 1048576 bytes in 10.074668 seconds lhsmtool_posix: 1762458745.813874 [101633]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' to '/tmp/arc1/sanity-hsm.test_204//0564/0x200000403:0x167:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.814016 [101633]: Action completed, notifying coordinator cookie=0x690d8e8e, FID=[0x200000403:0x167:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.814355 [101634]: copied 1048576 bytes in 10.056809 seconds lhsmtool_posix: 1762458745.814386 [101634]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' to '/tmp/arc1/sanity-hsm.test_204//056b/0x200000403:0x168:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.814478 [101634]: Action completed, notifying coordinator cookie=0x690d8e8f, FID=[0x200000403:0x168:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.815239 [101638]: copied 1048576 bytes in 10.040683 seconds lhsmtool_posix: 1762458745.815282 [101638]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' to '/tmp/arc1/sanity-hsm.test_204//056f/0x200000403:0x16c:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.815362 [101638]: Action completed, notifying coordinator cookie=0x690d8e93, FID=[0x200000403:0x16c:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.815567 [101640]: copied 1048576 bytes in 10.062308 seconds lhsmtool_posix: 1762458745.815642 [101640]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' to '/tmp/arc1/sanity-hsm.test_204//056d/0x200000403:0x16e:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762458745.820063 [101640]: Action completed, notifying coordinator cookie=0x690d8e95, FID=[0x200000403:0x16e:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762458745.821033 [101636]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16a:0x0' ok (rc=0) lhsmtool_posix: 1762458745.830791 [101637]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16b:0x0' ok (rc=0) lhsmtool_posix: 1762458745.852202 [101634]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x168:0x0' ok (rc=0) lhsmtool_posix: 1762458745.852283 [101632]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x166:0x0' ok (rc=0) lhsmtool_posix: 1762458745.852499 [101635]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x169:0x0' ok (rc=0) lhsmtool_posix: 1762458745.852822 [101639]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16d:0x0' ok (rc=0) lhsmtool_posix: 1762458745.855484 [101633]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x167:0x0' ok (rc=0) lhsmtool_posix: 1762458745.856034 [101638]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16c:0x0' ok (rc=0) lhsmtool_posix: 1762458745.870085 [101640]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x16e:0x0' ok (rc=0) lhsmtool_posix: 1762458754.008100 [101535]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762458758.981209 [101534]: process finished, errs: 10 major, 0 minor, rc=0 (Success)