== replay-single test 88: MDS should not assign same objid to different files ========================================================== 03:30:38 (1769761838) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2136 1269168 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3833116 9840 3597180 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1644 3605376 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 11484 7202556 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2136 1269168 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3833116 9840 3597180 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1644 3605376 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 11484 7202556 1% /mnt/lustre before test: last_id = 11649, next_id = 11620 Creating to objid 11649 on ost lustre-OST0000... total: 31 open/close in 0.09 seconds: 348.41 ops/second total: 8 open/close in 0.02 seconds: 359.21 ops/second before recovery: last_id = 11681, next_id = 11658 Stopping /mnt/lustre-mds1 (opts:) on oleg613-server Stopping /mnt/lustre-ost1 (opts:) on oleg613-server Failover mds1 to oleg613-server oleg613-server.virtnet Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg613-server: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg613-client: oleg613-server: ssh exited with exit code 1 Started lustre-MDT0000 Failover ost1 to oleg613-server oleg613-server.virtnet Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg613-server: oleg613-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg613-client: oleg613-server: ssh exited with exit code 1 Started lustre-OST0000 after recovery: last_id = 11689, next_id = 11658 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0311385 s, 16.8 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0310271 s, 16.9 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0305341 s, 17.2 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0295488 s, 17.7 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0297805 s, 17.6 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0310303 s, 16.9 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.031759 s, 16.5 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0298874 s, 17.5 MB/s -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11620 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11621 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11622 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11623 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11624 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11625 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11626 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11627 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11628 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11629 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11630 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11631 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11632 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11633 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11634 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11635 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11636 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11637 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11638 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11639 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11640 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11641 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11642 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11643 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11644 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11645 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11646 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11647 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11648 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11649 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11650 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11651 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11652 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11653 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11654 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11655 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11656 -rw-r--r-- 1 root root 0 Jan 30 03:30 /mnt/lustre/d88.replay-single/f-11657 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11661 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11662 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11663 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11664 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11665 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11666 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11667 -rw-r--r-- 1 root root 524288 Jan 30 03:31 /mnt/lustre/d88.replay-single/f-11668 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0296514 s, 17.7 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0302732 s, 17.3 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0295977 s, 17.7 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0296496 s, 17.7 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0276387 s, 19.0 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.032891 s, 15.9 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0331684 s, 15.8 MB/s 128+0 records in 128+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0312924 s, 16.8 MB/s