lhsmtool_posix: 1762455410.333041 [11755]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455410.378432 [11756]: waiting for message from kernel lhsmtool_posix: 1762455410.464952 [11757]: freezing thread IOs lhsmtool_posix: 1762455414.215830 [11756]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455414.218770 [11857]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cef4b lhsmtool_posix: 1762455414.219629 [11860]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cef4e lhsmtool_posix: 1762455414.219910 [11859]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cef4d lhsmtool_posix: 1762455414.220889 [11756]: waiting for message from kernel lhsmtool_posix: 1762455414.221345 [11864]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cef52 lhsmtool_posix: 1762455414.221705 [11863]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cef51 lhsmtool_posix: 1762455414.221903 [11862]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cef50 lhsmtool_posix: 1762455414.222113 [11858]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cef4c lhsmtool_posix: 1762455414.222313 [11866]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cef54 lhsmtool_posix: 1762455414.223077 [11865]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cef53 lhsmtool_posix: 1762455414.223634 [11861]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cef4f lhsmtool_posix: 1762455414.234795 [11857]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455414.242320 [11860]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455414.244661 [11859]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455414.257570 [11863]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455414.257881 [11862]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455414.259021 [11864]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455414.262786 [11861]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455414.262976 [11865]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455414.263571 [11866]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455414.265716 [11858]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455414.307340 [11857]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455414.310013 [11857]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov lhsmtool_posix: 1762455414.320224 [11862]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455414.320441 [11862]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov lhsmtool_posix: 1762455414.327884 [11860]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455414.328535 [11860]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov lhsmtool_posix: 1762455414.329930 [11864]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455414.330082 [11864]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov lhsmtool_posix: 1762455414.355320 [11863]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455414.355486 [11863]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov lhsmtool_posix: 1762455414.358265 [11861]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455414.358438 [11861]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov lhsmtool_posix: 1762455414.363782 [11860]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455414.364469 [11864]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455414.364642 [11857]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455414.374463 [11862]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455414.374864 [11858]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455414.374993 [11858]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov lhsmtool_posix: 1762455414.375821 [11859]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455414.375913 [11859]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov lhsmtool_posix: 1762455414.376352 [11866]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455414.376417 [11866]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov lhsmtool_posix: 1762455414.379405 [11865]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455414.379581 [11865]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov lhsmtool_posix: 1762455414.385689 [11861]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455414.387414 [11863]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455414.395001 [11858]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455414.397085 [11865]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455414.397246 [11859]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455414.397377 [11866]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455422.087050 [11757]: canceling running request matching [0x200000403:0x3:0x0] lhsmtool_posix: 1762455422.373388 [11857]: copied 1048576 bytes in 8.063135 seconds lhsmtool_posix: 1762455422.373458 [11857]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.373621 [11857]: Action completed, notifying coordinator cookie=0x690cef4b, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.382685 [11857]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0) lhsmtool_posix: 1762455422.899283 [11757]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455422.904737 [11862]: copied 1048576 bytes in 8.584056 seconds lhsmtool_posix: 1762455422.904968 [11862]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.905045 [11862]: Action completed, notifying coordinator cookie=0x690cef50, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.906351 [11863]: copied 1048576 bytes in 8.550651 seconds lhsmtool_posix: 1762455422.906384 [11863]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.906445 [11863]: Action completed, notifying coordinator cookie=0x690cef51, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.909054 [11858]: copied 1048576 bytes in 8.533917 seconds lhsmtool_posix: 1762455422.909104 [11858]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.909176 [11858]: Action completed, notifying coordinator cookie=0x690cef4c, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.915825 [11861]: copied 1048576 bytes in 8.557220 seconds lhsmtool_posix: 1762455422.915889 [11861]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.915987 [11861]: Action completed, notifying coordinator cookie=0x690cef4f, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.916694 [11859]: copied 1048576 bytes in 8.540683 seconds lhsmtool_posix: 1762455422.916724 [11859]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.916781 [11859]: Action completed, notifying coordinator cookie=0x690cef4d, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.923036 [11865]: copied 1048576 bytes in 8.543269 seconds lhsmtool_posix: 1762455422.923108 [11865]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.923209 [11865]: Action completed, notifying coordinator cookie=0x690cef53, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.932687 [11862]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0) lhsmtool_posix: 1762455422.934886 [11863]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0) lhsmtool_posix: 1762455422.936315 [11858]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455422.943377 [11866]: copied 1048576 bytes in 8.566844 seconds lhsmtool_posix: 1762455422.943436 [11866]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455422.943802 [11859]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0) lhsmtool_posix: 1762455422.944634 [11861]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455422.945454 [11865]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455422.946957 [11866]: Action completed, notifying coordinator cookie=0x690cef54, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455422.960914 [11866]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455423.384400 [11860]: copied 1048576 bytes in 9.055683 seconds lhsmtool_posix: 1762455423.384490 [11860]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455423.384651 [11860]: Action completed, notifying coordinator cookie=0x690cef4e, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455423.392875 [11864]: copied 1048576 bytes in 9.062629 seconds lhsmtool_posix: 1762455423.392954 [11864]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455423.393069 [11864]: Action completed, notifying coordinator cookie=0x690cef52, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455423.401261 [11860]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455423.402894 [11864]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455430.363782 [11757]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455435.390556 [11756]: process finished, errs: 10 major, 0 minor, rc=0 (Success)