lhsmtool_posix: 1762455734.779328 [11747]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1762455734.841337 [11748]: waiting for message from kernel lhsmtool_posix: 1762455734.887842 [11749]: freezing thread IOs lhsmtool_posix: 1762455738.198789 [11748]: copytool fs=lustre archive#=2 item_count=10 lhsmtool_posix: 1762455738.199307 [11850]: [0x200000403:0x4:0x0] action ARCHIVE reclen 72, cookie=0x690cf095 lhsmtool_posix: 1762455738.199463 [11851]: [0x200000403:0x5:0x0] action ARCHIVE reclen 72, cookie=0x690cf096 lhsmtool_posix: 1762455738.200070 [11852]: [0x200000403:0x6:0x0] action ARCHIVE reclen 72, cookie=0x690cf097 lhsmtool_posix: 1762455738.200325 [11855]: [0x200000403:0x9:0x0] action ARCHIVE reclen 72, cookie=0x690cf09a lhsmtool_posix: 1762455738.201616 [11748]: waiting for message from kernel lhsmtool_posix: 1762455738.202091 [11857]: [0x200000403:0xb:0x0] action ARCHIVE reclen 72, cookie=0x690cf09c lhsmtool_posix: 1762455738.205134 [11853]: [0x200000403:0x7:0x0] action ARCHIVE reclen 72, cookie=0x690cf098 lhsmtool_posix: 1762455738.207515 [11851]: processing file 'd204.sanity-hsm/f204.sanity-hsm03' lhsmtool_posix: 1762455738.208092 [11856]: [0x200000403:0xa:0x0] action ARCHIVE reclen 72, cookie=0x690cf09b lhsmtool_posix: 1762455738.208502 [11850]: processing file 'd204.sanity-hsm/f204.sanity-hsm02' lhsmtool_posix: 1762455738.212510 [11858]: [0x200000403:0xc:0x0] action ARCHIVE reclen 72, cookie=0x690cf09d lhsmtool_posix: 1762455738.213122 [11857]: processing file 'd204.sanity-hsm/f204.sanity-hsm09' lhsmtool_posix: 1762455738.215038 [11852]: processing file 'd204.sanity-hsm/f204.sanity-hsm04' lhsmtool_posix: 1762455738.205268 [11854]: [0x200000403:0x8:0x0] action ARCHIVE reclen 72, cookie=0x690cf099 lhsmtool_posix: 1762455738.218760 [11856]: processing file 'd204.sanity-hsm/f204.sanity-hsm08' lhsmtool_posix: 1762455738.207369 [11849]: [0x200000403:0x3:0x0] action ARCHIVE reclen 72, cookie=0x690cf094 lhsmtool_posix: 1762455738.237493 [11854]: processing file 'd204.sanity-hsm/f204.sanity-hsm06' lhsmtool_posix: 1762455738.237493 [11853]: processing file 'd204.sanity-hsm/f204.sanity-hsm05' lhsmtool_posix: 1762455738.238297 [11858]: processing file 'd204.sanity-hsm/f204.sanity-hsm10' lhsmtool_posix: 1762455738.239838 [11855]: processing file 'd204.sanity-hsm/f204.sanity-hsm07' lhsmtool_posix: 1762455738.240985 [11849]: processing file 'd204.sanity-hsm/f204.sanity-hsm01' lhsmtool_posix: 1762455738.318560 [11850]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455738.318729 [11850]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' in /tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp.lov lhsmtool_posix: 1762455738.347368 [11852]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455738.347534 [11852]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' in /tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp.lov lhsmtool_posix: 1762455738.348091 [11851]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455738.348166 [11851]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' in /tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp.lov lhsmtool_posix: 1762455738.349273 [11856]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455738.349385 [11856]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' in /tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp.lov lhsmtool_posix: 1762455738.349420 [11850]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp' lhsmtool_posix: 1762455738.349485 [11854]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455738.349577 [11854]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' in /tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp.lov lhsmtool_posix: 1762455738.349841 [11853]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455738.349895 [11857]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455738.349926 [11853]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' in /tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp.lov lhsmtool_posix: 1762455738.349958 [11857]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' in /tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp.lov lhsmtool_posix: 1762455738.356884 [11858]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455738.357019 [11858]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' in /tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp.lov lhsmtool_posix: 1762455738.358529 [11849]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455738.358623 [11849]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' in /tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp.lov lhsmtool_posix: 1762455738.362538 [11855]: archiving '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455738.362726 [11855]: saving stripe info of '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' in /tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp.lov lhsmtool_posix: 1762455738.364244 [11852]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp' lhsmtool_posix: 1762455738.364636 [11851]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp' lhsmtool_posix: 1762455738.364878 [11853]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp' lhsmtool_posix: 1762455738.364969 [11857]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp' lhsmtool_posix: 1762455738.374190 [11856]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp' lhsmtool_posix: 1762455738.374366 [11854]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp' lhsmtool_posix: 1762455738.375230 [11849]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp' lhsmtool_posix: 1762455738.375298 [11858]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp' lhsmtool_posix: 1762455738.381502 [11855]: start copy of 1048576 bytes from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp' lhsmtool_posix: 1762455746.174990 [11749]: canceling running request matching [0x200000403:0x3:0x0] lhsmtool_posix: 1762455746.407647 [11849]: copied 1048576 bytes in 8.048904 seconds lhsmtool_posix: 1762455746.407725 [11849]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' to '/tmp/arc1/sanity-hsm.test_204//0400/0x200000403:0x3:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455746.407852 [11849]: Action completed, notifying coordinator cookie=0x690cf094, FID=[0x200000403:0x3:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455746.417104 [11849]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x3:0x0' ok (rc=0) lhsmtool_posix: 1762455747.000970 [11749]: canceling 9 threads for '/mnt/lustre2' service lhsmtool_posix: 1762455747.381450 [11850]: copied 1048576 bytes in 9.062575 seconds lhsmtool_posix: 1762455747.381529 [11850]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' to '/tmp/arc1/sanity-hsm.test_204//0407/0x200000403:0x4:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.381644 [11850]: Action completed, notifying coordinator cookie=0x690cf095, FID=[0x200000403:0x4:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.395335 [11858]: copied 1048576 bytes in 9.038185 seconds lhsmtool_posix: 1762455747.395409 [11858]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' to '/tmp/arc1/sanity-hsm.test_204//040f/0x200000403:0xc:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.395531 [11858]: Action completed, notifying coordinator cookie=0x690cf09d, FID=[0x200000403:0xc:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.403903 [11855]: copied 1048576 bytes in 9.041003 seconds lhsmtool_posix: 1762455747.403962 [11855]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' to '/tmp/arc1/sanity-hsm.test_204//040a/0x200000403:0x9:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.404060 [11855]: Action completed, notifying coordinator cookie=0x690cf09a, FID=[0x200000403:0x9:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.404814 [11851]: copied 1048576 bytes in 9.056535 seconds lhsmtool_posix: 1762455747.404844 [11851]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' to '/tmp/arc1/sanity-hsm.test_204//0406/0x200000403:0x5:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.404899 [11851]: Action completed, notifying coordinator cookie=0x690cf096, FID=[0x200000403:0x5:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.409783 [11857]: copied 1048576 bytes in 9.059718 seconds lhsmtool_posix: 1762455747.409846 [11857]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' to '/tmp/arc1/sanity-hsm.test_204//0408/0x200000403:0xb:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.409938 [11857]: Action completed, notifying coordinator cookie=0x690cf09c, FID=[0x200000403:0xb:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.411308 [11854]: copied 1048576 bytes in 9.061642 seconds lhsmtool_posix: 1762455747.411357 [11854]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' to '/tmp/arc1/sanity-hsm.test_204//040b/0x200000403:0x8:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.411435 [11854]: Action completed, notifying coordinator cookie=0x690cf099, FID=[0x200000403:0x8:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.411827 [11850]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x4:0x0' ok (rc=0) lhsmtool_posix: 1762455747.416274 [11858]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xc:0x0' ok (rc=0) lhsmtool_posix: 1762455747.416641 [11853]: copied 1048576 bytes in 9.066604 seconds lhsmtool_posix: 1762455747.416665 [11853]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' to '/tmp/arc1/sanity-hsm.test_204//0404/0x200000403:0x7:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.416747 [11853]: Action completed, notifying coordinator cookie=0x690cf098, FID=[0x200000403:0x7:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.422557 [11855]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x9:0x0' ok (rc=0) lhsmtool_posix: lhsmtool_posix: 1762455747.430664 [11851]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x5:0x0' ok (rc=0) 1762455747.427147 [11857]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xb:0x0' ok (rc=0) lhsmtool_posix: 1762455747.431135 [11856]: copied 1048576 bytes in 9.081627 seconds lhsmtool_posix: 1762455747.431166 [11856]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' to '/tmp/arc1/sanity-hsm.test_204//0409/0x200000403:0xa:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.431316 [11856]: Action completed, notifying coordinator cookie=0x690cf09b, FID=[0x200000403:0xa:0x0], hp_flags=0 err=125 lhsmtool_posix: lhsmtool_posix: 1762455747.434322 [11854]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x8:0x0' ok (rc=0) 1762455747.434103 [11853]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x7:0x0' ok (rc=0) lhsmtool_posix: 1762455747.434422 [11852]: copied 1048576 bytes in 9.086724 seconds lhsmtool_posix: 1762455747.435155 [11852]: data copy failed from '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' to '/tmp/arc1/sanity-hsm.test_204//0405/0x200000403:0x6:0x0_tmp': Operation canceled (125) lhsmtool_posix: 1762455747.436075 [11852]: Action completed, notifying coordinator cookie=0x690cf097, FID=[0x200000403:0x6:0x0], hp_flags=0 err=125 lhsmtool_posix: 1762455747.446679 [11856]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0xa:0x0' ok (rc=0) lhsmtool_posix: 1762455747.448654 [11852]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000403:0x6:0x0' ok (rc=0) lhsmtool_posix: 1762455754.684062 [11749]: unfreezing thread IOs exiting: Terminated lhsmtool_posix: 1762455758.453069 [11748]: process finished, errs: 10 major, 0 minor, rc=0 (Success)