lhsmtool_posix: 1762455706.824802 [11778]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2
lhsmtool_posix: 1762455706.868419 [11779]: waiting for message from kernel
lhsmtool_posix: 1762455706.890066 [11780]: freezing thread IOs
lhsmtool_posix: 1762455709.811606 [11779]: copytool fs=lustre archive#=2 item_count=10
lhsmtool_posix: 1762455709.818277 [11779]: waiting for message from kernel
lhsmtool_posix: 1762455709.818785 [11889]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cf080
lhsmtool_posix: 1762455709.819305 [11887]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cf07e
lhsmtool_posix: 1762455709.819508 [11884]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cf07b
lhsmtool_posix: 1762455709.819715 [11883]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cf07a
lhsmtool_posix: 1762455709.819967 [11881]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cf078
lhsmtool_posix: 1762455709.820215 [11886]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cf07d
lhsmtool_posix: 1762455709.820433 [11880]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cf077
lhsmtool_posix: 1762455709.820643 [11885]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cf07c
lhsmtool_posix: 1762455709.821495 [11888]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cf07f
lhsmtool_posix: 1762455709.822021 [11882]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cf079
lhsmtool_posix: 1762455709.834866 [11882]: processing file 'd204.sanity-hsm/f204.sanity-hsm03'
lhsmtool_posix: 1762455709.835589 [11889]: processing file 'd204.sanity-hsm/f204.sanity-hsm10'
lhsmtool_posix: 1762455709.836068 [11888]: processing file 'd204.sanity-hsm/f204.sanity-hsm09'
lhsmtool_posix: 1762455709.858886 [11887]: processing file 'd204.sanity-hsm/f204.sanity-hsm08'
lhsmtool_posix: 1762455709.859676 [11884]: processing file 'd204.sanity-hsm/f204.sanity-hsm05'
lhsmtool_posix: 1762455709.860121 [11883]: processing file 'd204.sanity-hsm/f204.sanity-hsm04'
lhsmtool_posix: 1762455709.860504 [11881]: processing file 'd204.sanity-hsm/f204.sanity-hsm02'
lhsmtool_posix: 1762455709.860880 [11886]: processing file 'd204.sanity-hsm/f204.sanity-hsm07'
lhsmtool_posix: 1762455709.861307 [11880]: processing file 'd204.sanity-hsm/f204.sanity-hsm01'
lhsmtool_posix: 1762455709.861708 [11885]: processing file 'd204.sanity-hsm/f204.sanity-hsm06'
lhsmtool_posix: 1762455709.945023 [11888]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455709.945299 [11888]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov
lhsmtool_posix: 1762455709.946542 [11882]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455709.946693 [11882]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov
lhsmtool_posix: 1762455709.973273 [11889]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455709.973507 [11889]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov
lhsmtool_posix: 1762455709.979828 [11887]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455709.980059 [11887]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov
lhsmtool_posix: 1762455709.987470 [11884]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455709.987701 [11884]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov
lhsmtool_posix: 1762455709.995377 [11886]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455709.995590 [11886]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov
lhsmtool_posix: 1762455709.996590 [11888]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp'
lhsmtool_posix: 1762455709.999547 [11881]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455709.999763 [11881]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov
lhsmtool_posix: 1762455710.010442 [11882]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp'
lhsmtool_posix: 1762455710.010821 [11883]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455710.010994 [11883]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov
lhsmtool_posix: 1762455710.014404 [11889]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp'
lhsmtool_posix: 1762455710.017254 [11880]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455710.017466 [11880]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov
lhsmtool_posix: 1762455710.018219 [11887]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp'
lhsmtool_posix: 1762455710.020119 [11884]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp'
lhsmtool_posix: 1762455710.028545 [11886]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp'
lhsmtool_posix: 1762455710.028730 [11885]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455710.028892 [11885]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov
lhsmtool_posix: 1762455710.038658 [11881]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp'
lhsmtool_posix: 1762455710.043859 [11883]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp'
lhsmtool_posix: 1762455710.044448 [11880]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp'
lhsmtool_posix: 1762455710.045414 [11885]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp'
lhsmtool_posix: 1762455720.527175 [11780]: canceling running request matching [0x200000403:0x3:0x0]
lhsmtool_posix: 1762455720.579456 [11880]: copied 1048576 bytes in 10.555020 seconds
lhsmtool_posix: 1762455720.579541 [11880]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455720.579686 [11880]: Action completed, notifying coordinator cookie=0x690cf077, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455720.599534 [11880]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0)
lhsmtool_posix: 1762455721.811955 [11780]: canceling 9 threads for '/mnt/lustre2' service
lhsmtool_posix: 1762455722.032649 [11882]: copied 1048576 bytes in 12.085807 seconds
lhsmtool_posix: 1762455722.032737 [11882]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.032883 [11882]: Action completed, notifying coordinator cookie=0x690cf079, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.053606 [11882]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.054968 [11886]: copied 1048576 bytes in 12.059196 seconds
lhsmtool_posix: 1762455722.055019 [11886]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.055163 [11886]: Action completed, notifying coordinator cookie=0x690cf07d, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.056843 [11889]: copied 1048576 bytes in 12.083152 seconds
lhsmtool_posix: 1762455722.056920 [11889]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.057026 [11889]: Action completed, notifying coordinator cookie=0x690cf080, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.060131 [11888]: copied 1048576 bytes in 12.114570 seconds
lhsmtool_posix: 1762455722.060221 [11888]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.060356 [11888]: Action completed, notifying coordinator cookie=0x690cf07f, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.074815 [11888]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.074833 [11886]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.075339 [11889]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.081330 [11884]: copied 1048576 bytes in 12.093409 seconds
lhsmtool_posix: 1762455722.081466 [11884]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.081562 [11884]: Action completed, notifying coordinator cookie=0x690cf07b, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.083212 [11887]: copied 1048576 bytes in 12.102948 seconds
lhsmtool_posix: 1762455722.083280 [11887]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.083387 [11887]: Action completed, notifying coordinator cookie=0x690cf07e, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.091864 [11885]: copied 1048576 bytes in 12.062748 seconds
lhsmtool_posix: 1762455722.091963 [11885]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.092132 [11885]: Action completed, notifying coordinator cookie=0x690cf07c, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.098124 [11884]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.098574 [11887]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.104448 [11881]: copied 1048576 bytes in 12.104509 seconds
lhsmtool_posix: 1762455722.104526 [11881]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.104637 [11881]: Action completed, notifying coordinator cookie=0x690cf078, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.112160 [11883]: copied 1048576 bytes in 12.100892 seconds
lhsmtool_posix: 1762455722.112252 [11883]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125)
lhsmtool_posix: 1762455722.112384 [11883]: Action completed, notifying coordinator cookie=0x690cf07a, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125
lhsmtool_posix: 1762455722.115335 [11885]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.134545 [11883]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0)
lhsmtool_posix: 1762455722.135143 [11881]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0)
lhsmtool_posix: 1762455730.332499 [11780]: unfreezing thread IOs
exiting: Terminated
lhsmtool_posix: 1762455735.548950 [11779]: process finished, errs: 10 major, 0 minor, rc=0 (Success)