== sanity-sec test 75b: test resource ID and PFID repair ========================================================== 13:14:27 (1763144067) 1 1 obdfilter.lustre-OST0000.enable_resource_id_repair=0 obdfilter.lustre-OST0001.enable_resource_id_repair=0 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [/home/green/git/lustre-release/lustre/utils/lfs] [setstripe] [-c] [1] [-i] [0] [/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec] Check OST object IDs (1) - should be unset after file create oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 07666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000000:00000000 User: 0 Group: 0 Project: 0 Size: 0 File ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 EXTENTS: running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec] [bs=1M] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0563403 s, 18.6 MB/s Check OST object IDs (2) - should be set after writting to file Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg356-server mds-ost sync done. oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 0666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=4194304 stripe_count=1 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (3) - should be unset after untagging Stopping clients: oleg356-client.virtnet /mnt/lustre (opts:) Stopping client oleg356-client.virtnet /mnt/lustre opts: Stopping clients: oleg356-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg356-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg356-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg356-server oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) debugfs: sif O/240000400/d2/2 mode 0107666 debugfs: sif O/240000400/d2/2 uid 0 debugfs: sif O/240000400/d2/2 gid 0 debugfs: sif O/240000400/d2/2 projid 0 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-OST0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client oleg356-client.virtnet: -o user_xattr,flock 192.168.203.156@tcp:/lustre /mnt/lustre Mount client oleg356-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.156@tcp:/lustre /mnt/lustre Started clients oleg356-client.virtnet: 192.168.203.156@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) obdfilter.lustre-OST0000.enable_resource_id_repair=0 obdfilter.lustre-OST0001.enable_resource_id_repair=0 oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 07666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 0 Group: 0 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=4194304 stripe_count=1 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (4) - should remain unset with read running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [of=/dev/null] [if=/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec] [bs=1M] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0829022 s, 12.6 MB/s Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg356-server mds-ost sync done. oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 07666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 0 Group: 0 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=4194304 stripe_count=1 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 obdfilter.lustre-OST0000.enable_resource_id_repair=1 obdfilter.lustre-OST0001.enable_resource_id_repair=1 Check OST object IDs (5) - should be set after repair due to read running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [of=/dev/null] [if=/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec] [bs=1M] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0850265 s, 12.3 MB/s oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 01666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=4194304 stripe_count=1 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (6) - should be set after setting projid Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg356-server mds-ost sync done. oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 0666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 42 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=4194304 stripe_count=1 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (7) - wipe pfid Stopping clients: oleg356-client.virtnet /mnt/lustre (opts:) Stopping client oleg356-client.virtnet /mnt/lustre opts: Stopping clients: oleg356-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg356-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg356-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg356-server oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) Retrieved parent FID before wiping: '0x200000401:0x2:0x0' oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) debugfs: ea_rm O/240000400/d2/2 trusted.fid Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-OST0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client oleg356-client.virtnet: -o user_xattr,flock 192.168.203.156@tcp:/lustre /mnt/lustre Mount client oleg356-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.156@tcp:/lustre /mnt/lustre Started clients oleg356-client.virtnet: 192.168.203.156@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Check OST object IDs (8) - should be unset after untagging pfid oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 0666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 42 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (9) - should be set after repair due to read running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [of=/dev/null] [if=/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec] [bs=1M] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0870364 s, 12.0 MB/s oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 0666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 42 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=0 stripe_count=0 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (10) - wipe pfid and ids Stopping clients: oleg356-client.virtnet /mnt/lustre (opts:) Stopping client oleg356-client.virtnet /mnt/lustre opts: Stopping clients: oleg356-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg356-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg356-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg356-server oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) Retrieved parent FID before wiping: '0x200000401:0x2:0x0' oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) debugfs: sif O/240000400/d2/2 mode 0107666 debugfs: sif O/240000400/d2/2 uid 0 debugfs: sif O/240000400/d2/2 gid 0 debugfs: sif O/240000400/d2/2 projid 0 oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) debugfs: ea_rm O/240000400/d2/2 trusted.fid Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-MDT0000 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-OST0000 Start ost2: mount -t lustre -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg356-server: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client oleg356-client.virtnet: -o user_xattr,flock 192.168.203.156@tcp:/lustre /mnt/lustre Mount client oleg356-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.156@tcp:/lustre /mnt/lustre Started clients oleg356-client.virtnet: 192.168.203.156@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) Check OST object IDs (11) - pfid and ids should be unset oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 07666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 0 Group: 0 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 EXTENTS: (0-255):77568-77823 oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 07666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 0 Group: 0 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 EXTENTS: (0-255):77568-77823 Check OST object IDs (12) - should be set after repair running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [of=/dev/null] [if=/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec] [bs=1M] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12405 s, 8.5 MB/s oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 01666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=0 stripe_count=0 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 oleg356-server: debugfs 1.47.3-wc1 (8-Aug-2025) OST object metadata dump for file '/mnt/lustre/d75b.sanity-sec/f75b.sanity-sec': Inode: 103 Type: regular Mode: 01666 Flags: 0x80000 Generation: 1713922488 Version: 0x00000001:00000005 User: 500 Group: 500 Project: 0 Size: 1048576 File ACL: 0 Links: 1 Blockcount: 2048 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 atime: 0x00000000:00000000 -- Wed Dec 31 19:00:00 1969 mtime: 0x69177187:00000000 -- Fri Nov 14 13:14:31 2025 crtime: 0x691770fd:45613b00 -- Fri Nov 14 13:12:13 2025 Size of extra inode fields: 32 Extended attributes: lma: fid=[0x240000400:0x2:0x0] compat=8 incompat=0 fid: parent=[0x200000401:0x2:0x0] stripe=0 stripe_size=0 stripe_count=0 layout_version=0 range=0 EXTENTS: (0-255):77568-77823 obdfilter.lustre-OST0000.enable_resource_id_repair=1 obdfilter.lustre-OST0001.enable_resource_id_repair=1