lhsmtool_posix: 1762455319.941721 [11792]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455319.991483 [11793]: waiting for message from kernel lhsmtool_posix: 1762455320.038507 [11794]: freezing thread IOs lhsmtool_posix: 1762455323.248088 [11793]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455323.249501 [11793]: waiting for message from kernel lhsmtool_posix: 1762455323.249977 [11899]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690ceef8 lhsmtool_posix: 1762455323.250436 [11898]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690ceef7 lhsmtool_posix: 1762455323.250669 [11897]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690ceef6 lhsmtool_posix: 1762455323.250878 [11895]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690ceef4 lhsmtool_posix: 1762455323.251096 [11901]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690ceefa lhsmtool_posix: 1762455323.251316 [11900]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690ceef9 lhsmtool_posix: 1762455323.251515 [11896]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690ceef5 lhsmtool_posix: 1762455323.270127 [11904]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690ceefd lhsmtool_posix: 1762455323.270343 [11903]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690ceefc lhsmtool_posix: 1762455323.271631 [11898]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455323.273288 [11899]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455323.274228 [11895]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455323.274440 [11900]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455323.274576 [11901]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455323.277473 [11897]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455323.278452 [11896]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455323.280799 [11903]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455323.270312 [11902]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690ceefb lhsmtool_posix: 1762455323.318426 [11904]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455323.320774 [11902]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455323.358956 [11895]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455323.359205 [11895]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov lhsmtool_posix: 1762455323.368112 [11898]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455323.370022 [11898]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov lhsmtool_posix: 1762455323.376491 [11901]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455323.376752 [11901]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov lhsmtool_posix: 1762455323.377586 [11896]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455323.377683 [11896]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov lhsmtool_posix: 1762455323.394545 [11895]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455323.395069 [11899]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455323.396515 [11899]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov lhsmtool_posix: 1762455323.403099 [11901]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455323.403433 [11904]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: lhsmtool_posix: 1762455323.403629 [11904]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov 1762455323.403602 [11897]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455323.403839 [11897]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov lhsmtool_posix: 1762455323.404999 [11900]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455323.405126 [11900]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov lhsmtool_posix: 1762455323.405718 [11903]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455323.405789 [11903]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov lhsmtool_posix: 1762455323.423015 [11898]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455323.428074 [11896]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455323.428670 [11902]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455323.428861 [11902]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov lhsmtool_posix: 1762455323.428909 [11899]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455323.436264 [11904]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455323.441749 [11897]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455323.442022 [11900]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455323.442578 [11903]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455323.447975 [11902]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455331.686676 [11794]: canceling running request matching [0x200000403:0x3:0x0] lhsmtool_posix: 1762455331.917379 [11895]: copied 1048576 bytes in 8.557829 seconds lhsmtool_posix: 1762455331.917462 [11895]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455331.917587 [11895]: Action completed, notifying coordinator cookie=0x690ceef4, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455331.933878 [11895]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0) lhsmtool_posix: 1762455332.641165 [11794]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455332.942528 [11901]: copied 1048576 bytes in 9.565573 seconds lhsmtool_posix: 1762455332.942606 [11901]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455332.942720 [11901]: Action completed, notifying coordinator cookie=0x690ceefa, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455332.944861 [11898]: copied 1048576 bytes in 9.574602 seconds lhsmtool_posix: 1762455332.944922 [11898]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455332.945023 [11898]: Action completed, notifying coordinator cookie=0x690ceef7, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455332.965127 [11896]: copied 1048576 bytes in 9.580264 seconds lhsmtool_posix: 1762455332.965214 [11896]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'lhsmtool_posix: 1762455332.968593 [11900]: copied 1048576 bytes in 9.563281 seconds lhsmtool_posix: 1762455332.968667 [11900]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455332.968775 [11900]: Action completed, notifying coordinator cookie=0x690ceef9, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125 : Operation canceled (125) lhsmtool_posix: 1762455332.969039 [11896]: Action completed, notifying coordinator cookie=0x690ceef5, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455332.969355 [11901]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0) lhsmtool_posix: 1762455332.972675 [11904]: copied 1048576 bytes in 9.568759 seconds lhsmtool_posix: 1762455332.972754 [11904]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455332.972857 [11904]: Action completed, notifying coordinator cookie=0x690ceefd, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455332.976774 [11902]: copied 1048576 bytes in 9.547718 seconds lhsmtool_posix: 1762455332.976860 [11902]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455332.977035 [11902]: Action completed, notifying coordinator cookie=0x690ceefb, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455332.980369 [11899]: copied 1048576 bytes in 9.583644 seconds lhsmtool_posix: 1762455332.980450 [11899]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455332.980533 [11899]: Action completed, notifying coordinator cookie=0x690ceef8, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455332.988901 [11898]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455333.004832 [11902]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455333.009417 [11897]: copied 1048576 bytes in 9.605373 seconds lhsmtool_posix: 1762455333.009511 [11897]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455333.009632 [11897]: Action completed, notifying coordinator cookie=0x690ceef6, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455333.011611 [11903]: copied 1048576 bytes in 9.605712 seconds lhsmtool_posix: 1762455333.011686 [11903]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455333.011797 [11903]: Action completed, notifying coordinator cookie=0x690ceefc, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455333.013010 [11900]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0) lhsmtool_posix: 1762455333.013984 [11896]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455333.030774 [11899]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455333.031740 [11904]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455333.036649 [11897]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0) lhsmtool_posix: 1762455333.038547 [11903]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455340.930782 [11794]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455345.556689 [11793]: process finished, errs: 10 major, 0 minor, rc=0 (Success)