lhsmtool_posix: 1762455359.180532 [11735]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455359.220436 [11736]: waiting for message from kernel
lhsmtool_posix: 1762455359.259810 [11737]: freezing thread IOs
lhsmtool_posix: 1762455362.858886 [11736]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455362.859727 [11838]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cef1a
lhsmtool_posix: 1762455362.859850 [11839]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cef1b
lhsmtool_posix: 1762455362.860207 [11840]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cef1c
lhsmtool_posix: 1762455362.860305 [11841]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cef1d
lhsmtool_posix: 1762455362.861124 [11844]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cef20
lhsmtool_posix: 1762455362.861210 [11845]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cef21
lhsmtool_posix: 1762455362.861543 [11736]: waiting for message from kernel
lhsmtool_posix: lhsmtool_posix: 1762455362.861631 [11843]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cef1f
1762455362.861397 [11842]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cef1e
lhsmtool_posix: 1762455362.861600 [11847]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cef23
lhsmtool_posix: 1762455362.861490 [11846]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cef22
lhsmtool_posix: 1762455362.867016 [11845]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455362.868377 [11839]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455362.868818 [11844]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455362.868960 [11838]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455362.869048 [11840]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455362.869547 [11846]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455362.869671 [11847]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455362.870899 [11843]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455362.872261 [11841]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455362.874330 [11842]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455362.901236 [11845]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455362.902929 [11845]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455362.911898 [11844]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455362.912167 [11844]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455362.921711 [11839]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455362.921953 [11839]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455362.924026 [11846]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455362.924235 [11846]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455362.925221 [11843]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455362.925341 [11843]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455362.925890 [11838]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455362.925962 [11838]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov
lhsmtool_posix: 1762455362.926834 [11847]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455362.926957 [11847]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455362.922514 [11840]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455362.930018 [11840]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455362.941015 [11844]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455362.942545 [11841]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455362.942790 [11841]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455362.943742 [11845]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455362.948393 [11842]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455362.948680 [11842]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455362.950011 [11847]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455362.950323 [11846]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455362.950413 [11843]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455362.950891 [11839]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455362.951535 [11838]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455362.959759 [11840]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455362.960319 [11842]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455362.960466 [11841]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455371.264962 [11737]: canceling running request matching [0x200000403:0x3:0x0]
lhsmtool_posix: 1762455371.471095 [11838]: copied 1048576 bytes in 8.545039 seconds
lhsmtool_posix: 1762455371.471192 [11838]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455371.471343 [11838]: Action completed, notifying coordinator cookie=0x690cef1a, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455371.494389 [11838]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.122715 [11737]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455372.456265 [11845]: copied 1048576 bytes in 9.553113 seconds
lhsmtool_posix: 1762455372.456365 [11845]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.456496 [11845]: Action completed, notifying coordinator cookie=0x690cef21, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: lhsmtool_posix: 1762455372.476098 [11846]: copied 1048576 bytes in 9.551693 seconds
lhsmtool_posix: 1762455372.476158 [11846]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125)
1762455372.475006 [11843]: copied 1048576 bytes in 9.549516 seconds
lhsmtool_posix: 1762455372.476252 [11843]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.476290 [11846]: Action completed, notifying coordinator cookie=0x690cef22, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.476316 [11843]: Action completed, notifying coordinator cookie=0x690cef1f, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.480174 [11845]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.480840 [11847]: copied 1048576 bytes in 9.553771 seconds
lhsmtool_posix: 1762455372.480877 [11847]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.480999 [11847]: Action completed, notifying coordinator cookie=0x690cef23, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.483935 [11844]: copied 1048576 bytes in 9.571569 seconds
lhsmtool_posix: 1762455372.484023 [11844]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.484189 [11844]: Action completed, notifying coordinator cookie=0x690cef20, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.485529 [11841]: copied 1048576 bytes in 9.542543 seconds
lhsmtool_posix: 1762455372.485681 [11841]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.485784 [11841]: Action completed, notifying coordinator cookie=0x690cef1d, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.487426 [11839]: copied 1048576 bytes in 9.565286 seconds
lhsmtool_posix: 1762455372.487498 [11839]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.487652 [11839]: Action completed, notifying coordinator cookie=0x690cef1b, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.491487 [11842]: copied 1048576 bytes in 9.542616 seconds
lhsmtool_posix: 1762455372.491604 [11842]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.491742 [11842]: Action completed, notifying coordinator cookie=0x690cef1e, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.505452 [11840]: copied 1048576 bytes in 9.575264 seconds
lhsmtool_posix: 1762455372.505530 [11840]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455372.505835 [11840]: Action completed, notifying coordinator cookie=0x690cef1c, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455372.507656 [11841]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0)
lhsmtool_posix: lhsmtool_posix: 1762455372.507989 [11844]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0)
1762455372.507996 [11843]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.512469 [11842]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.513049 [11847]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.513758 [11846]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.513988 [11839]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455372.532517 [11840]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455378.555525 [11737]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455382.410634 [11736]: process finished, errs: 10 major, 0 minor, rc=0 (Success)