lhsmtool_posix: 1762455318.703884 [11811]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455318.769967 [11812]: waiting for message from kernel lhsmtool_posix: 1762455318.784298 [11813]: freezing thread IOs lhsmtool_posix: 1762455322.809077 [11812]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455322.809598 [11915]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690ceef2 lhsmtool_posix: 1762455322.809727 [11914]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690ceef1 lhsmtool_posix: lhsmtool_posix: 1762455322.821176 [11919]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690ceef6 1762455322.821120 [11917]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690ceef4 lhsmtool_posix: 1762455322.821328 [11920]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690ceef7 lhsmtool_posix: 1762455322.821823 [11918]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690ceef5 lhsmtool_posix: 1762455322.821789 [11916]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690ceef3 lhsmtool_posix: 1762455322.828183 [11812]: waiting for message from kernel lhsmtool_posix: 1762455322.828707 [11923]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690ceefa lhsmtool_posix: 1762455322.829010 [11921]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690ceef8 lhsmtool_posix: 1762455322.829527 [11922]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690ceef9 lhsmtool_posix: 1762455322.842186 [11915]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455322.842372 [11923]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455322.842611 [11918]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455322.843101 [11916]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455322.844676 [11914]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455322.847985 [11920]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455322.853602 [11921]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455322.854273 [11917]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455322.854431 [11919]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455322.862533 [11922]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455322.959038 [11921]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455322.959213 [11921]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov lhsmtool_posix: 1762455322.982876 [11915]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455322.983045 [11915]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov lhsmtool_posix: 1762455322.985033 [11920]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455322.985179 [11920]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov lhsmtool_posix: 1762455322.996247 [11923]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455322.996412 [11923]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov lhsmtool_posix: 1762455322.998827 [11914]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455322.998975 [11914]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov lhsmtool_posix: 1762455323.011088 [11918]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455323.011263 [11918]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov lhsmtool_posix: 1762455323.011882 [11916]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455323.011969 [11916]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov lhsmtool_posix: 1762455323.013617 [11921]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455323.015139 [11919]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455323.015319 [11919]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov lhsmtool_posix: 1762455323.020908 [11917]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455323.021073 [11917]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov lhsmtool_posix: 1762455323.022026 [11922]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455323.022179 [11922]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov lhsmtool_posix: 1762455323.022928 [11915]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455323.034790 [11914]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455323.035036 [11920]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455323.036185 [11918]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455323.036641 [11923]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455323.040930 [11916]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455323.041535 [11917]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455323.041780 [11922]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455323.042081 [11919]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455333.359460 [11813]: canceling running request matching [0x200000403:0x3:0x0] lhsmtool_posix: 1762455333.556641 [11914]: copied 1048576 bytes in 10.557480 seconds lhsmtool_posix: 1762455333.556706 [11914]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455333.556821 [11914]: Action completed, notifying coordinator cookie=0x690ceef1, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455333.601483 [11914]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0) lhsmtool_posix: 1762455334.367710 [11813]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455334.530603 [11921]: copied 1048576 bytes in 11.571211 seconds lhsmtool_posix: 1762455334.531856 [11921]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.531981 [11921]: Action completed, notifying coordinator cookie=0x690ceef8, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.551489 [11915]: copied 1048576 bytes in 11.568281 seconds lhsmtool_posix: 1762455334.551580 [11915]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.551710 [11915]: Action completed, notifying coordinator cookie=0x690ceef2, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.553969 [11921]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455334.554102 [11918]: copied 1048576 bytes in 11.542660 seconds lhsmtool_posix: 1762455334.554169 [11918]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.554335 [11918]: Action completed, notifying coordinator cookie=0x690ceef5, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.560197 [11919]: copied 1048576 bytes in 11.544298 seconds lhsmtool_posix: 1762455334.560293 [11919]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.560471 [11919]: Action completed, notifying coordinator cookie=0x690ceef6, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.561978 [11923]: copied 1048576 bytes in 11.565418 seconds lhsmtool_posix: lhsmtool_posix: 1762455334.562060 [11920]: copied 1048576 bytes in 11.576756 seconds lhsmtool_posix: 1762455334.562120 [11920]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.562238 [11920]: Action completed, notifying coordinator cookie=0x690ceef7, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125 1762455334.562052 [11923]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.562678 [11923]: Action completed, notifying coordinator cookie=0x690ceefa, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.566753 [11917]: copied 1048576 bytes in 11.545529 seconds lhsmtool_posix: 1762455334.566832 [11917]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.566949 [11917]: Action completed, notifying coordinator cookie=0x690ceef4, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.567612 [11920]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0) lhsmtool_posix: 1762455334.568937 [11923]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455334.569121 [11919]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0) lhsmtool_posix: 1762455334.569436 [11922]: copied 1048576 bytes in 11.547144 seconds lhsmtool_posix: 1762455334.569463 [11922]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.569787 [11918]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455334.570143 [11922]: Action completed, notifying coordinator cookie=0x690ceef9, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.570634 [11915]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455334.582861 [11922]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455334.584216 [11917]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455334.605671 [11916]: copied 1048576 bytes in 11.593596 seconds lhsmtool_posix: 1762455334.605739 [11916]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455334.605836 [11916]: Action completed, notifying coordinator cookie=0x690ceef3, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455334.636753 [11916]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0) lhsmtool_posix: 1762455342.060468 [11813]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455347.034813 [11812]: process finished, errs: 10 major, 0 minor, rc=0 (Success)