lhsmtool_posix: 1762455314.544927 [11799]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455314.586689 [11800]: waiting for message from kernel lhsmtool_posix: 1762455314.664185 [11801]: freezing thread IOs lhsmtool_posix: 1762455319.419254 [11800]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455319.420300 [11901]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690ceeec lhsmtool_posix: 1762455319.423669 [11903]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690ceeee lhsmtool_posix: 1762455319.424569 [11902]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690ceeed lhsmtool_posix: 1762455319.425969 [11904]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690ceeef lhsmtool_posix: 1762455319.436307 [11901]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455319.438869 [11903]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455319.440438 [11906]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690ceef1 lhsmtool_posix: 1762455319.440758 [11904]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455319.440912 [11902]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455319.441356 [11800]: waiting for message from kernel lhsmtool_posix: 1762455319.442013 [11905]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690ceef0 lhsmtool_posix: 1762455319.442167 [11907]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690ceef2 lhsmtool_posix: 1762455319.442370 [11909]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690ceef4 lhsmtool_posix: 1762455319.442539 [11910]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690ceef5 lhsmtool_posix: 1762455319.442816 [11908]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690ceef3 lhsmtool_posix: 1762455319.461865 [11907]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455319.462860 [11909]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455319.467939 [11905]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455319.468639 [11910]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455319.469332 [11906]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455319.471331 [11908]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455319.539540 [11901]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455319.539726 [11901]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov lhsmtool_posix: 1762455319.540293 [11903]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455319.540368 [11903]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov lhsmtool_posix: 1762455319.553364 [11905]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455319.553566 [11905]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov lhsmtool_posix: 1762455319.558555 [11902]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455319.558840 [11902]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov lhsmtool_posix: 1762455319.559517 [11904]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455319.559728 [11904]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov lhsmtool_posix: 1762455319.562368 [11906]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455319.562550 [11906]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov lhsmtool_posix: 1762455319.572741 [11909]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455319.572946 [11909]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov lhsmtool_posix: 1762455319.573476 [11901]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455319.573598 [11910]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455319.573678 [11910]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov lhsmtool_posix: 1762455319.574023 [11905]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455319.574083 [11907]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455319.574265 [11907]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov lhsmtool_posix: 1762455319.578050 [11903]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455319.581548 [11908]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455319.581700 [11908]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov lhsmtool_posix: 1762455319.593361 [11904]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455319.596708 [11902]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455319.596891 [11906]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455319.597155 [11910]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455319.600064 [11909]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455319.600372 [11907]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455319.603168 [11908]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455327.558447 [11801]: canceling running request matching [0x200000403:0x3:0x0] lhsmtool_posix: 1762455327.594106 [11901]: copied 1048576 bytes in 8.054202 seconds lhsmtool_posix: 1762455327.594177 [11901]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455327.594292 [11901]: Action completed, notifying coordinator cookie=0x690ceeec, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455327.612493 [11901]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0) lhsmtool_posix: 1762455328.704296 [11801]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455329.082165 [11905]: copied 1048576 bytes in 9.528405 seconds lhsmtool_posix: 1762455329.082234 [11905]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.085153 [11905]: Action completed, notifying coordinator cookie=0x690ceef0, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.105482 [11906]: copied 1048576 bytes in 9.542759 seconds lhsmtool_posix: 1762455329.105550 [11906]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.105640 [11906]: Action completed, notifying coordinator cookie=0x690ceef1, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.112872 [11909]: copied 1048576 bytes in 9.539767 seconds lhsmtool_posix: 1762455329.112933 [11909]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.113022 [11909]: Action completed, notifying coordinator cookie=0x690ceef4, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.114357 [11904]: copied 1048576 bytes in 9.554392 seconds lhsmtool_posix: 1762455329.114396 [11904]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.114460 [11904]: Action completed, notifying coordinator cookie=0x690ceeef, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.116292 [11910]: copied 1048576 bytes in 9.542515 seconds lhsmtool_posix: 1762455329.116335 [11910]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.116438 [11910]: Action completed, notifying coordinator cookie=0x690ceef5, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.116999 [11907]: copied 1048576 bytes in 9.542488 seconds lhsmtool_posix: 1762455329.117024 [11907]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.117076 [11907]: Action completed, notifying coordinator cookie=0x690ceef2, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.119712 [11906]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0) lhsmtool_posix: 1762455329.120042 [11905]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455329.120182 [11902]: copied 1048576 bytes in 9.558633 seconds lhsmtool_posix: 1762455329.120206 [11902]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.120286 [11902]: Action completed, notifying coordinator cookie=0x690ceeed, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.125234 [11903]: copied 1048576 bytes in 9.584753 seconds lhsmtool_posix: 1762455329.125297 [11903]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.125395 [11903]: Action completed, notifying coordinator cookie=0x690ceeee, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.137092 [11904]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455329.137623 [11910]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455329.137644 [11909]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455329.147393 [11908]: copied 1048576 bytes in 9.565496 seconds lhsmtool_posix: 1762455329.147465 [11908]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455329.147588 [11908]: Action completed, notifying coordinator cookie=0x690ceef3, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455329.156123 [11902]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455329.156839 [11903]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0) lhsmtool_posix: 1762455329.156901 [11907]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0) lhsmtool_posix: 1762455329.176977 [11908]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455336.651122 [11801]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455341.435902 [11800]: process finished, errs: 10 major, 0 minor, rc=0 (Success)