lhsmtool_posix: 1716998335.137324 lhsmtool_posix[15385]: action=0 src=(null) dst=(null) mount_point=/mnt/lustre2 lhsmtool_posix: 1716998335.157271 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.278173 lhsmtool_posix[15386]: copytool fs=lustre archive#=1 item_count=3 lhsmtool_posix: 1716998343.281135 lhsmtool_posix[15920]: [0x200000402:0x34c:0x0] action ARCHIVE reclen 72, cookie=0x66574fcc lhsmtool_posix: 1716998343.282591 lhsmtool_posix[15921]: [0x200000402:0x34e:0x0] action RESTORE reclen 72, cookie=0x66574fcd lhsmtool_posix: 1716998343.285227 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.285260 lhsmtool_posix[15922]: [0x200000402:0x350:0x0] action REMOVE reclen 72, cookie=0x66574fce lhsmtool_posix: 1716998343.285447 lhsmtool_posix[15386]: copytool fs=lustre archive#=2 item_count=1 lhsmtool_posix: 1716998343.285520 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.285543 lhsmtool_posix[15923]: [0x200000402:0x353:0x0] action ARCHIVE reclen 72, cookie=0x66574fcf lhsmtool_posix: 1716998343.286370 lhsmtool_posix[15920]: processing file 'd250.sanity-hsm/f250.sanity-hsm-to-archive.bis' lhsmtool_posix: 1716998343.287926 lhsmtool_posix[15921]: processing file 'd250.sanity-hsm/f250.sanity-hsm-to-restore.bis' lhsmtool_posix: 1716998343.288010 lhsmtool_posix[15921]: reading stripe rules from '/tmp/arc1/sanity-hsm.test_251//074c/0x200000402:0x34e:0x0.lov' for '/tmp/arc1/sanity-hsm.test_251//074c/0x200000402:0x34e:0x0' lhsmtool_posix: 1716998343.288047 lhsmtool_posix[15921]: cannot open '/tmp/arc1/sanity-hsm.test_251//074c/0x200000402:0x34e:0x0.lov': No such file or directory (2) lhsmtool_posix: 1716998343.288086 lhsmtool_posix[15921]: cannot get stripe rules for '/tmp/arc1/sanity-hsm.test_251//074c/0x200000402:0x34e:0x0' (No data available), use default lhsmtool_posix: 1716998343.289075 lhsmtool_posix[15922]: processing file 'd250.sanity-hsm/f250.sanity-hsm-to-remove.bis' lhsmtool_posix: 1716998343.291603 lhsmtool_posix[15923]: processing file 'd251.sanity-hsm/f251.sanity-hsm' lhsmtool_posix: 1716998343.295806 lhsmtool_posix[15922]: removing file '/tmp/arc1/sanity-hsm.test_251//0752/0x200000402:0x350:0x0' lhsmtool_posix: 1716998343.295867 lhsmtool_posix[15922]: cannot unlink '/tmp/arc1/sanity-hsm.test_251//0752/0x200000402:0x350:0x0': No such file or directory (2) lhsmtool_posix: 1716998343.295894 lhsmtool_posix[15922]: Action completed, notifying coordinator cookie=0x66574fce, FID=[0x200000402:0x350:0x0], hp_flags=0 err=2 lhsmtool_posix: 1716998343.314584 lhsmtool_posix[15920]: llapi_hsm_action_begin() on '/mnt/lustre2/.lustre/fid/0x200000402:0x34c:0x0' failed: No such file or directory (2) lhsmtool_posix: 1716998343.314660 lhsmtool_posix[15920]: Action completed, notifying coordinator cookie=0x66574fcc, FID=[0x200000402:0x34c:0x0], hp_flags=0 err=2 lhsmtool_posix: 1716998343.318391 lhsmtool_posix[15920]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x34c:0x0' failed: No such file or directory (2) exiting: Terminated lhsmtool_posix: 1716998343.323424 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.323453 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.323552 lhsmtool_posix[15923]: llapi_hsm_action_begin() on '/mnt/lustre2/.lustre/fid/0x200000402:0x353:0x0' failed: No such file or directory (2) lhsmtool_posix: lhsmtool_posix: 1716998343.323626 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.323645 lhsmtool_posix[15386]: waiting for message from kernel 1716998343.323628 lhsmtool_posix[15923]: Action completed, notifying coordinator cookie=0x66574fcf, FID=[0x200000402:0x353:0x0], hp_flags=0 err=2 lhsmtool_posix: 1716998343.323734 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.323749 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.323825 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.323853 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.323932 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.323973 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324042 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324054 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324125 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324137 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324211 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324222 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324295 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324308 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324382 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324394 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324465 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324475 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324548 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324558 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324630 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324641 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324728 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324742 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324816 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324829 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.324904 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.324917 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325009 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325024 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325099 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325112 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325182 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325195 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325268 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325280 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325347 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325358 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325424 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325435 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325500 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325510 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325575 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325585 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325650 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325660 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325757 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325770 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325845 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325857 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.325932 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.325962 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326033 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326046 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326121 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326134 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326211 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326225 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326297 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326308 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326379 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326389 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326462 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326473 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326548 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326559 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.326633 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.326645 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.328702 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.328736 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.328835 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.328847 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.328922 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.328935 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329027 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329040 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329114 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329127 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329200 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329213 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329286 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329300 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329374 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329387 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329460 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329473 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329548 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329561 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329658 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329671 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329758 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329771 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329845 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329859 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.329932 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.329964 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.330040 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.330054 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.330127 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.330140 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.330259 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.330274 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.330348 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.330361 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.330434 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.330447 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.330523 lhsmtool_posix[15386]: cannot receive action list: Bad file descriptor lhsmtool_posix: 1716998343.330536 lhsmtool_posix[15386]: waiting for message from kernel lhsmtool_posix: 1716998343.333027 lhsmtool_posix[15923]: llapi_hsm_action_end() on '/mnt/lustre2/.lustre/fid/0x200000402:0x353:0x0' failed: No such file or directory (2)