lhsmtool_posix: 1762455393.975655 [11803]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455394.023051 [11804]: waiting for message from kernel
lhsmtool_posix: 1762455394.058583 [11805]: freezing thread IOs
lhsmtool_posix: 1762455397.918471 [11804]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455397.919058 [11905]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cef3e
lhsmtool_posix: 1762455397.924338 [11804]: waiting for message from kernel
lhsmtool_posix: 1762455397.930012 [11912]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cef45
lhsmtool_posix: 1762455397.924892 [11911]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cef44
lhsmtool_posix: 1762455397.930838 [11914]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cef47
lhsmtool_posix: 1762455397.925024 [11906]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cef3f
lhsmtool_posix: 1762455397.925110 [11907]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cef40
lhsmtool_posix: 1762455397.924864 [11909]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cef42
lhsmtool_posix: 1762455397.924879 [11908]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cef41
lhsmtool_posix: 1762455397.925037 [11910]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cef43
lhsmtool_posix: 1762455397.924937 [11913]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cef46
lhsmtool_posix: 1762455397.954293 [11911]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455397.955389 [11906]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455397.957723 [11908]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455397.958655 [11914]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455397.959042 [11907]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455397.959353 [11910]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455397.959822 [11912]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455397.960190 [11913]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455397.961904 [11905]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455397.962275 [11909]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455398.016590 [11906]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455398.016773 [11906]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455398.019598 [11911]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455398.019757 [11911]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455398.021633 [11908]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455398.021761 [11908]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455398.043575 [11910]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455398.043735 [11910]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455398.047466 [11905]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455398.047625 [11905]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov
lhsmtool_posix: 1762455398.047979 [11914]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455398.048055 [11914]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455398.048261 [11908]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455398.048374 [11907]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455398.048443 [11907]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455398.048460 [11912]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455398.048525 [11912]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455398.048902 [11906]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455398.048982 [11911]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455398.061652 [11905]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455398.061818 [11909]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455398.061916 [11909]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455398.064919 [11913]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455398.065065 [11913]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455398.065689 [11910]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455398.068281 [11912]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455398.068450 [11907]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455398.068615 [11914]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455398.071090 [11913]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455398.072394 [11909]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455407.237842 [11805]: canceling running request matching [0x200000403:0x3:0x0]
lhsmtool_posix: 1762455407.586145 [11905]: copied 1048576 bytes in 9.538332 seconds
lhsmtool_posix: 1762455407.586243 [11905]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455407.586389 [11905]: Action completed, notifying coordinator cookie=0x690cef3e, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455407.627306 [11905]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.359930 [11805]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455408.582772 [11908]: copied 1048576 bytes in 10.560883 seconds
lhsmtool_posix: 1762455408.582865 [11908]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.585329 [11908]: Action completed, notifying coordinator cookie=0x690cef41, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.597898 [11912]: copied 1048576 bytes in 10.549264 seconds
lhsmtool_posix: 1762455408.597973 [11912]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.598076 [11912]: Action completed, notifying coordinator cookie=0x690cef45, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.601974 [11907]: copied 1048576 bytes in 10.553448 seconds
lhsmtool_posix: 1762455408.602156 [11907]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.602284 [11907]: Action completed, notifying coordinator cookie=0x690cef40, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.602361 [11908]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.607533 [11906]: copied 1048576 bytes in 10.590613 seconds
lhsmtool_posix: 1762455408.607688 [11906]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.607813 [11906]: Action completed, notifying coordinator cookie=0x690cef3f, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.612069 [11910]: copied 1048576 bytes in 10.568194 seconds
lhsmtool_posix: 1762455408.612374 [11910]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.612407 [11912]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.612494 [11910]: Action completed, notifying coordinator cookie=0x690cef43, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.617511 [11907]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.622203 [11906]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.625223 [11911]: copied 1048576 bytes in 10.605329 seconds
lhsmtool_posix: 1762455408.625297 [11911]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.625406 [11911]: Action completed, notifying coordinator cookie=0x690cef44, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.632456 [11910]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.635876 [11914]: copied 1048576 bytes in 10.587732 seconds
lhsmtool_posix: 1762455408.635953 [11914]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.636067 [11914]: Action completed, notifying coordinator cookie=0x690cef47, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.639269 [11913]: copied 1048576 bytes in 10.574060 seconds
lhsmtool_posix: 1762455408.639343 [11913]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.639489 [11913]: Action completed, notifying coordinator cookie=0x690cef46, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.641170 [11909]: copied 1048576 bytes in 10.579127 seconds
lhsmtool_posix: 1762455408.641230 [11909]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455408.641328 [11909]: Action completed, notifying coordinator cookie=0x690cef42, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455408.651068 [11911]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0)
lhsmtool_posix: lhsmtool_posix: 1762455408.657884 [11909]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0)
1762455408.657884 [11913]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455408.673800 [11914]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455416.679691 [11805]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455421.578834 [11804]: process finished, errs: 10 major, 0 minor, rc=0 (Success)