lhsmtool_posix: 1762455431.307130 [11838]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455431.361278 [11839]: waiting for message from kernel
lhsmtool_posix: 1762455431.420397 [11840]: freezing thread IOs
lhsmtool_posix: 1762455435.797349 [11839]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455435.801261 [11941]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cef64
lhsmtool_posix: 1762455435.805024 [11942]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cef65
lhsmtool_posix: 1762455435.812034 [11941]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455435.815645 [11942]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455435.816260 [11947]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cef6a
lhsmtool_posix: 1762455435.816664 [11949]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cef6c
lhsmtool_posix: 1762455435.816743 [11943]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cef66
lhsmtool_posix: lhsmtool_posix: 1762455435.817910 [11950]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cef6d
1762455435.817865 [11839]: waiting for message from kernel
lhsmtool_posix: 1762455435.824118 [11944]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cef67
lhsmtool_posix: 1762455435.823280 [11948]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cef6b
lhsmtool_posix: 1762455435.828488 [11947]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455435.823189 [11945]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cef68
lhsmtool_posix: 1762455435.829866 [11950]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455435.831482 [11949]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455435.823123 [11946]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cef69
lhsmtool_posix: 1762455435.842720 [11948]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455435.846427 [11943]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455435.859062 [11946]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455435.860999 [11944]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455435.861729 [11945]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455435.878885 [11942]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455435.879119 [11942]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455435.879990 [11941]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455435.880130 [11941]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov
lhsmtool_posix: 1762455435.896440 [11948]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455435.896669 [11948]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455435.897959 [11949]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455435.898093 [11949]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455435.904848 [11941]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455435.904777 [11947]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455435.905119 [11947]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455435.907403 [11950]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455435.907570 [11950]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455435.908907 [11942]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455435.911234 [11948]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455435.911497 [11949]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455435.911687 [11945]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455435.911817 [11945]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455435.912196 [11943]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455435.912260 [11943]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455435.913761 [11946]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455435.913913 [11946]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455435.914297 [11944]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455435.914371 [11944]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455435.918967 [11947]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: lhsmtool_posix: 1762455435.919829 [11945]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
1762455435.919844 [11944]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455435.919951 [11943]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455435.919971 [11950]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455435.920071 [11946]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455443.745208 [11840]: canceling running request matching [0x200000403:0x3:0x0]
lhsmtool_posix: 1762455443.914507 [11941]: copied 1048576 bytes in 8.034224 seconds
lhsmtool_posix: 1762455443.914710 [11941]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455443.914858 [11941]: Action completed, notifying coordinator cookie=0x690cef64, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455443.926833 [11941]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.554732 [11840]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455444.925378 [11942]: copied 1048576 bytes in 9.046088 seconds
lhsmtool_posix: 1762455444.925449 [11942]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.925607 [11942]: Action completed, notifying coordinator cookie=0x690cef65, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.928059 [11948]: copied 1048576 bytes in 9.031230 seconds
lhsmtool_posix: 1762455444.928122 [11948]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.928233 [11949]: copied 1048576 bytes in 9.030015 seconds
lhsmtool_posix: 1762455444.928272 [11949]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.928239 [11948]: Action completed, notifying coordinator cookie=0x690cef6b, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.928321 [11949]: Action completed, notifying coordinator cookie=0x690cef6c, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.929849 [11947]: copied 1048576 bytes in 9.024576 seconds
lhsmtool_posix: 1762455444.929883 [11947]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.929970 [11947]: Action completed, notifying coordinator cookie=0x690cef6a, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.935620 [11944]: copied 1048576 bytes in 9.021156 seconds
lhsmtool_posix: 1762455444.935690 [11944]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.935790 [11944]: Action completed, notifying coordinator cookie=0x690cef67, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.936569 [11943]: copied 1048576 bytes in 9.024192 seconds
lhsmtool_posix: 1762455444.936599 [11943]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.936656 [11943]: Action completed, notifying coordinator cookie=0x690cef66, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.937918 [11945]: copied 1048576 bytes in 9.025914 seconds
lhsmtool_posix: 1762455444.937956 [11945]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.938024 [11945]: Action completed, notifying coordinator cookie=0x690cef68, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.942211 [11950]: copied 1048576 bytes in 9.034485 seconds
lhsmtool_posix: 1762455444.942279 [11950]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.942386 [11950]: Action completed, notifying coordinator cookie=0x690cef6d, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.945740 [11949]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.947113 [11948]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.947432 [11942]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.952729 [11946]: copied 1048576 bytes in 9.038679 seconds
lhsmtool_posix: 1762455444.952791 [11946]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455444.952904 [11946]: Action completed, notifying coordinator cookie=0x690cef69, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455444.967646 [11944]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.968871 [11947]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.970385 [11945]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.973223 [11943]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.978669 [11946]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455444.984788 [11950]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455452.607226 [11840]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455458.080924 [11839]: process finished, errs: 10 major, 0 minor, rc=0 (Success)