lhsmtool_posix: 1762455499.308930 [10841]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455499.350174 [10842]: waiting for message from kernel lhsmtool_posix: 1762455499.407629 [10843]: freezing thread IOs lhsmtool_posix: 1762455502.592797 [10842]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455502.593367 [10944]: [0x200000402:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cefa9 lhsmtool_posix: 1762455502.593855 [10943]: [0x200000402:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cefa8 lhsmtool_posix: 1762455502.594799 [10945]: [0x200000402:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cefaa lhsmtool_posix: 1762455502.595543 [10948]: [0x200000402:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cefad lhsmtool_posix: 1762455502.595557 [10947]: [0x200000402:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cefac lhsmtool_posix: 1762455502.596330 [10946]: [0x200000402:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cefab lhsmtool_posix: 1762455502.595587 [10949]: [0x200000402:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cefae lhsmtool_posix: 1762455502.597892 [10943]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455502.598678 [10842]: waiting for message from kernel lhsmtool_posix: 1762455502.598992 [10952]: [0x200000402:0xd:0x0] action ARCHIVE reclen 72, cookie=0x690cefb1 lhsmtool_posix: 1762455502.599095 [10951]: [0x200000402:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cefb0 lhsmtool_posix: 1762455502.601326 [10944]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455502.601716 [10945]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455502.601978 [10950]: [0x200000402:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cefaf lhsmtool_posix: 1762455502.602793 [10948]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455502.603142 [10949]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455502.604508 [10946]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455502.615608 [10951]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455502.616969 [10947]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455502.624703 [10950]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455502.629459 [10952]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455502.659457 [10943]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp' lhsmtool_posix: 1762455502.659616 [10943]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp.lov lhsmtool_posix: 1762455502.667037 [10948]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp' lhsmtool_posix: 1762455502.667173 [10948]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp.lov lhsmtool_posix: 1762455502.687162 [10944]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp' lhsmtool_posix: 1762455502.687348 [10944]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp.lov lhsmtool_posix: 1762455502.688826 [10945]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp' lhsmtool_posix: 1762455502.688919 [10945]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp.lov lhsmtool_posix: 1762455502.697716 [10943]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp' lhsmtool_posix: 1762455502.698269 [10949]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp' lhsmtool_posix: 1762455502.698412 [10949]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp.lov lhsmtool_posix: 1762455502.703752 [10951]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp' lhsmtool_posix: 1762455502.703916 [10951]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp.lov lhsmtool_posix: 1762455502.707517 [10948]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp' lhsmtool_posix: 1762455502.707887 [10946]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp' lhsmtool_posix: 1762455502.707998 [10946]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp.lov lhsmtool_posix: 1762455502.708662 [10945]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp' lhsmtool_posix: 1762455502.708745 [10944]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp' lhsmtool_posix: 1762455502.708964 [10950]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp' lhsmtool_posix: 1762455502.709029 [10950]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp.lov lhsmtool_posix: 1762455502.712333 [10952]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp' lhsmtool_posix: 1762455502.712474 [10952]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp.lov lhsmtool_posix: 1762455502.712978 [10947]: archiving '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp' lhsmtool_posix: 1762455502.713056 [10947]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp.lov lhsmtool_posix: 1762455502.721690 [10949]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp' lhsmtool_posix: 1762455502.725891 [10951]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp' lhsmtool_posix: 1762455502.735572 [10950]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp' lhsmtool_posix: 1762455502.735761 [10947]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp' lhsmtool_posix: 1762455502.735911 [10946]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp' lhsmtool_posix: 1762455502.735994 [10952]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp' lhsmtool_posix: 1762455511.838974 [10843]: canceling running request matching [0x200000402:0x4:0x0] lhsmtool_posix: 1762455512.229831 [10943]: copied 1048576 bytes in 9.570088 seconds lhsmtool_posix: 1762455512.229889 [10943]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000402:0x4:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455512.229980 [10943]: Action completed, notifying coordinator cookie=0x690cefa8, FID=[0x200000402:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455512.261800 [10943]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455513.065051 [10843]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455513.245613 [10951]: copied 1048576 bytes in 10.541556 seconds lhsmtool_posix: 1762455513.245709 [10951]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040e/0x200000402:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.245839 [10951]: Action completed, notifying coordinator cookie=0x690cefb0, FID=[0x200000402:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.250132 [10948]: copied 1048576 bytes in 10.582799 seconds lhsmtool_posix: 1762455513.250216 [10948]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000402:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.250373 [10948]: Action completed, notifying coordinator cookie=0x690cefad, FID=[0x200000402:0x9:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.270397 [10944]: copied 1048576 bytes in 10.582909 seconds lhsmtool_posix: 1762455513.270481 [10944]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000402:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.270605 [10944]: Action completed, notifying coordinator cookie=0x690cefa9, FID=[0x200000402:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.286448 [10947]: copied 1048576 bytes in 10.573298 seconds lhsmtool_posix: 1762455513.286532 [10947]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000402:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.286652 [10947]: Action completed, notifying coordinator cookie=0x690cefac, FID=[0x200000402:0x8:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.287031 [10949]: copied 1048576 bytes in 10.588482 seconds lhsmtool_posix: 1762455513.287055 [10949]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000402:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.287108 [10949]: Action completed, notifying coordinator cookie=0x690cefae, FID=[0x200000402:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.287291 [10946]: copied 1048576 bytes in 10.579153 seconds lhsmtool_posix: 1762455513.287316 [10946]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000402:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.287366 [10946]: Action completed, notifying coordinator cookie=0x690cefab, FID=[0x200000402:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.287619 [10952]: copied 1048576 bytes in 10.575006 seconds lhsmtool_posix: 1762455513.287644 [10952]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000402:0xd:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.287709 [10952]: Action completed, notifying coordinator cookie=0x690cefb1, FID=[0x200000402:0xd:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.289331 [10950]: copied 1048576 bytes in 10.580206 seconds lhsmtool_posix: 1762455513.289395 [10950]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000402:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.289495 [10950]: Action completed, notifying coordinator cookie=0x690cefaf, FID=[0x200000402:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.290105 [10948]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x9:0x0' ok (rc=0) lhsmtool_posix: 1762455513.290604 [10951]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455513.295539 [10945]: copied 1048576 bytes in 10.606523 seconds lhsmtool_posix: 1762455513.295655 [10945]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000402:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455513.295780 [10945]: Action completed, notifying coordinator cookie=0x690cefaa, FID=[0x200000402:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455513.308861 [10947]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x8:0x0' ok (rc=0) lhsmtool_posix: 1762455513.312715 [10950]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455513.313716 [10952]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xd:0x0' ok (rc=0) lhsmtool_posix: 1762455513.313908 [10949]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455513.315151 [10944]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x5:0x0' ok (rc=0) lhsmtool_posix: 1762455513.324319 [10945]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455513.325732 [10946]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455522.736198 [10843]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455528.218680 [10842]: process finished, errs: 10 major, 0 minor, rc=0 (Success)