00010000:00010000:1.0F:1715205868.676009:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205869.677930:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0F:1715205870.487901:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715205870.487909:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0F:1715205870.487920:0:1965:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511133696:192.168.204.133@tcp:400:kworker.0 00000100:00100000:2.0:1715205870.488010:0:1965:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715205870.488017:0:1965:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:b074247a-b4e0-48d1-8030-d4461b52d5ca:1965:1798523511133760:192.168.204.133@tcp:400:kworker.0 00000100:00100000:2.0:1715205870.488734:0:1965:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:b074247a-b4e0-48d1-8030-d4461b52d5ca:1965:1798523511133760:192.168.204.133@tcp:400:kworker.0 00000100:00100000:2.0:1715205870.488741:0:1965:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511133696:192.168.204.133@tcp:400:kworker.0 00010000:00010000:0.0F:1715205870.679925:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205871.681990:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205872.163805:0:14081:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test 7: Stale pages after read-on-open ===== 18:04:31 (1715205871) 00000080:00200000:0.0:1715205872.183118:0:14096:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205872.183136:0:14096:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205872.183182:0:14096:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183188:0:14096:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183194:0:14096:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14096 initiator: MDT0 00000100:00100000:0.0:1715205872.183206:0:14096:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f84c0c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205872.183214:0:14096:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job dd:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:14096:1798523511133824:192.168.204.133@tcp:101:dd.0 00010000:00010000:0.0:1715205872.183221:0:14096:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183225:0:14096:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183227:0:14096:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183231:0:14096:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183235:0:14096:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183238:0:14096:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83180 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205872.183240:0:14096:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183243:0:14096:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183250:0:14096:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183254:0:14096:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205872.183258:0:14096:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 14096 initiator: MDT0 00010000:00010000:0.0:1715205872.183260:0:14096:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 14096 initiator: MDT0 00000080:00020000:0.0:1715205872.183287:0:14096:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715205872.186082:0:14102:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace MGC192.168.204.133@tcp 00010000:00010000:0.0:1715205872.186111:0:14102:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace lustre-MDT0000-mdc-ffff880136899800 00010000:00010000:2.0:1715205872.186119:0:14103:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace lustre-MDT0000-mdc-ffff8800a98fb800 00010000:00010000:0.0:1715205872.186126:0:14102:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace lustre-OST0000-osc-ffff8800a98fb800 00010000:00010000:2.0:1715205872.186136:0:14103:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1715205872.186146:0:4787:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715205872.186153:0:4787:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800b0a3cfc0/0x361984fab9c06aff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa4db7398a345ca66 expref: -99 pid: 11459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205872.186180:0:14105:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace lustre-OST0000-osc-ffff880136899800 00010000:00010000:1.0:1715205872.186191:0:14104:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace lustre-OST0001-osc-ffff8800a98fb800 00010000:00010000:0.0:1715205872.186191:0:4787:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800b0a3cfc0/0x361984fab9c06aff lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa4db7398a345ca66 expref: -99 pid: 11459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.186196:0:4787:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715205872.186209:0:4787:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:b074247a-b4e0-48d1-8030-d4461b52d5ca:4787:1798523511133888:192.168.204.133@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715205872.186210:0:14105:0:(ldlm_resource.c:316:lru_size_store()) dropping all unused locks from namespace lustre-OST0001-osc-ffff880136899800 00000100:00100000:0.0:1715205872.186277:0:4787:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f84c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715205872.187159:0:4787:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:b074247a-b4e0-48d1-8030-d4461b52d5ca:4787:1798523511133888:192.168.204.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715205872.187167:0:4787:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800b0a3cfc0/0x361984fab9c06aff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa4db7398a345ca66 expref: -99 pid: 11459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.187182:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205872.187186:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205872.187188:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1715205872.194459:0:14109:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:3.0:1715205872.194477:0:14109:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205872.194518:0:14109:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194525:0:14109:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194532:0:14109:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14109 initiator: MDT0 00000100:00100000:3.0:1715205872.194546:0:14109:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5bfac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715205872.194555:0:14109:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job multiop:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:14109:1798523511133952:192.168.204.133@tcp:101:multiop.0 00010000:00010000:3.0:1715205872.194562:0:14109:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194568:0:14109:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194572:0:14109:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194578:0:14109:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194583:0:14109:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194588:0:14109:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a3e880 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:3.0:1715205872.194592:0:14109:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194602:0:14109:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194607:0:14109:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194612:0:14109:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205872.194615:0:14109:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 14109 initiator: MDT0 00010000:00010000:3.0:1715205872.194620:0:14109:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3e880/0x361984fab9c06dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 14109 initiator: MDT0 00000080:00020000:3.0:1715205872.194635:0:14109:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205872.196706:0:14110:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:1.0:1715205872.196719:0:14110:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205872.196742:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14110 initiator: MDT0 00010000:00010000:1.0:1715205872.196748:0:14110:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14110 initiator: MDT0 00010000:00010000:1.0:1715205872.196755:0:14110:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14110 initiator: MDT0 00000100:00100000:1.0:1715205872.196767:0:14110:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134016:192.168.204.133@tcp:101:dd.0 00000100:00100000:1.0:1715205872.196839:0:14110:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851540 going to sleep for 11 seconds 00000100:00100000:1.0:1715205872.198035:0:14110:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134016:192.168.204.133@tcp:101:dd.0 00010000:00010000:1.0:1715205872.198045:0:14110:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198052:0:14110:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198061:0:14110:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198069:0:14110:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198090:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198096:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198102:0:14110:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1715205872.198111:0:14110:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012b1efb80 x1798523511134016/t0(0) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1715205888 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00010000:1.0:1715205872.198120:0:14110:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198127:0:14110:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e104400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1715205872.198143:0:14110:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 11776 00000080:00010000:1.0:1715205872.198148:0:14110:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06dde 00000080:00010000:1.0:1715205872.198153:0:14110:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:1.0:1715205872.198155:0:14110:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06dde from it ffff8800aaa87bb0 00010000:00010000:1.0:1715205872.198157:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198164:0:14110:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715205872.198179:0:14110:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715205872.198187:0:14110:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:1.0:1715205872.198197:0:14110:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205872.198203:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198210:0:14110:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715205872.198216:0:14110:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:1.0:1715205872.198218:0:14110:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06dde 00000080:00010000:1.0:1715205872.198221:0:14110:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06dde from it ffff8800aaa87ba0 00010000:00010000:1.0:1715205872.198223:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.198229:0:14110:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715205872.198235:0:14110:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8), inode mode 41ed mask 3 00000080:00200000:1.0:1715205872.198240:0:14110:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=f7.sanity-dom, dir=[0x200000007:0x1:0x0](ffff88012e7408c8), file ffff8800b58bf680, open_flags 8241, mode 81b6 opened 0 00000080:00200000:1.0:1715205872.198257:0:14110:0:(namei.c:838:ll_lookup_it()) VFS Op:name=f7.sanity-dom, dir=[0x200000007:0x1:0x0](ffff88012e7408c8), intent=open|creat 00000100:00100000:1.0:1715205872.198288:0:14110:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134080:192.168.204.133@tcp:700:dd.0 00000100:00100000:1.0:1715205872.198321:0:14110:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851540 going to sleep for 11 seconds 00000100:00100000:1.0:1715205872.199325:0:14110:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134080:192.168.204.133@tcp:700:dd.0 00000002:00010000:1.0:1715205872.199336:0:14110:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: f7.sanity-dom,[0x200000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0101102 00010000:00010000:1.0:1715205872.199346:0:14110:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.199368:0:14110:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.199376:0:14110:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205872.199378:0:14110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a2400/0x361984fab9c06dde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa4db7398a345ca9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.199398:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14110 initiator: MDT0 00010000:00010000:1.0:1715205872.199403:0:14110:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14110 initiator: MDT0 00000020:00100000:1.0:1715205872.199410:0:14110:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a98fb800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715205872.199415:0:14110:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b1efb80 x1798523511134208/t0(0) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 744/66408 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715205872.199423:0:14110:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14110 initiator: MDT0 00000100:00100000:1.0:1715205872.199432:0:14110:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134208:192.168.204.133@tcp:101:dd.0 00000100:00100000:1.0:1715205872.199499:0:14110:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851540 going to sleep for 11 seconds 00000100:00100000:1.0:1715205872.200950:0:14110:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134208:192.168.204.133@tcp:101:dd.0 00010000:00010000:1.0:1715205872.200959:0:14110:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.200971:0:14110:0:(ldlm_request.c:741:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.200976:0:14110:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.200982:0:14110:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.200993:0:14110:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.200999:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,2 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.201005:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,2 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205872.201009:0:14110:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1715205872.201015:0:14110:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff88012b1efb80 x1798523511134208/t4294967315(4294967315) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 744/824 e 0 to 0 dl 1715205888 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00100000:1.0:1715205872.201023:0:14110:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012b1efb80 x1798523511134208/t4294967315(4294967315) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 744/824 e 0 to 0 dl 1715205888 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000002:00010000:1.0:1715205872.201031:0:14110:0:(mdc_locks.c:942:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 216 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 0 00000002:00010000:1.0:1715205872.201037:0:14110:0:(mdc_locks.c:974:mdc_finish_enqueue()) ### DoM lock is returned by: open|creat, size: 0 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1715205872.201043:0:14110:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201049:0:14110:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e104400 type 13 mode 2 res 8589935618/1 (0 0) 00000080:00200000:1.0:1715205872.201058:0:14110:0:(namei.c:1424:ll_create_it()) VFS Op:name=f7.sanity-dom, dir=[0x200000007:0x1:0x0](ffff88012e7408c8), intent=open|creat 00000080:00200000:1.0:1715205872.201075:0:14110:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8800b23a20c8) 00000080:00200000:1.0:1715205872.201121:0:14110:0:(file.c:6276:ll_layout_conf()) [0x200000402:0x1:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:1.0:1715205872.201125:0:14110:0:(namei.c:1391:ll_create_node()) setting l_ast_data to inode [0x200000402:0x1:0x0](ffff8800b23a20c8) 00000080:00010000:1.0:1715205872.201128:0:14110:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1:0x0](ffff8800b23a20c8) for lock 0x361984fab9c06de5 00000080:00200008:1.0:1715205872.201143:0:14110:0:(file.c:871:ll_file_open()) START file f7.sanity-dom:[0x200000402:0x1:0x0](ffff8800b23a20c8), flags 101101 00000002:00100000:1.0:1715205872.201156:0:14110:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012b1efb80 x1798523511134208/t4294967315(4294967315) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 744/824 e 0 to 0 dl 1715205888 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000080:00010000:1.0:1715205872.201188:0:14110:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06de5 from it ffff8800b59e79c0 00010000:00010000:1.0:1715205872.201192:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201198:0:14110:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1715205872.201208:0:14110:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8800b23a20c8), inode mode 81a4 mask 40 00000080:00200008:1.0:1715205872.201291:0:14110:0:(file.c:2372:ll_file_write_iter()) START file f7.sanity-dom:[0x200000402:0x1:0x0], ppos: 0, count: 1000 00000080:00200000:1.0:1715205872.201299:0:14110:0:(rw26.c:814:ll_write_begin()) Writing 0 of 0 to 1000 bytes 00000080:00200000:1.0:1715205872.201302:0:14110:0:(file.c:2344:ll_do_tiny_write()) result: 0, original count 1000 00000080:00200000:1.0:1715205872.201306:0:14110:0:(file.c:1812:ll_file_io_generic()) f7.sanity-dom: write ppos: 0, bytes: 1000 00000080:00200000:1.0:1715205872.201309:0:14110:0:(file.c:1599:ll_io_set_mirror()) f7.sanity-dom: desiginated mirror: 0 00000020:00200000:1.0:1715205872.201314:0:14110:0:(cl_io.c:195:cl_io_rw_init()) header@ffff88012f84e4b0[0x4, 1, [0x200000402:0x1:0x0] hash] 00000020:00200000:1.0:1715205872.201316:0:14110:0:(cl_io.c:195:cl_io_rw_init()) io range: 2 [0, 1000) 0 0 00000080:00200000:1.0:1715205872.201319:0:14110:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:1.0:1715205872.201328:0:14110:0:(file.c:1879:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1715205872.201333:0:14110:0:(lov_io.c:1039:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 1000) 1000, 1000 00020000:00200000:1.0:1715205872.201336:0:14110:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1715205872.201346:0:14110:0:(vvp_io.c:215:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000002:00010000:1.0:1715205872.201354:0:14110:0:(lustre_osc.h:184:osc_enq2ldlm_flags()) flags: 0 00000002:00010000:1.0:1715205872.201359:0:14110:0:(mdc_dev.c:1003:mdc_lock_init()) ### lock ffff8800adc173b0, mdc lock ffff8800adc68130, flags 0 00010000:00010000:1.0:1715205872.201366:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201381:0:14110:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201389:0:14110:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 6/0,2 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1715205872.201396:0:14110:0:(mdc_dev.c:462:mdc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=0 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,2 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201403:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 6/0,2 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201408:0:14110:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1715205872.201414:0:14110:0:(vvp_io.c:1328:vvp_io_write_start()) f7.sanity-dom: write [0, 1000) 00000080:00200000:1.0:1715205872.201421:0:14110:0:(rw26.c:814:ll_write_begin()) Writing 0 of 0 to 1000 bytes 00000080:00200000:1.0:1715205872.201440:0:14110:0:(rw26.c:1003:ll_write_end()) pos 0, len 1000, copied 1000 00000080:00200000:1.0:1715205872.201445:0:14110:0:(rw26.c:1041:ll_write_end()) page@ffff8800aab161b0[3 ffff88012f84e530 2 1 ffff8800aa8bce10] 00000080:00200000:1.0:1715205872.201447:0:14110:0:(rw26.c:1041:ll_write_end()) vmpage @ffffea0002a296c0 1fffff00000805 3:0 ffff8800aab161b0 0 lru 00000080:00200000:1.0:1715205872.201453:0:14110:0:(rw26.c:1041:ll_write_end()) osc-page@ffff8800aab16210 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | ffff88012e24b1a8 ffff8800a99ae4b0 > 3< 0 0 > 4< 0 0 8 3407872 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1715205872.201454:0:14110:0:(rw26.c:1041:ll_write_end()) end page@ffff8800aab161b0 00000080:00200000:1.0:1715205872.201455:0:14110:0:(rw26.c:1041:ll_write_end()) queued page: 1. 00000080:00200000:1.0:1715205872.201458:0:14110:0:(vvp_io.c:1219:vvp_io_write_commit()) commit async pages: 1, from 0, to 1000 00000008:00010000:1.0:1715205872.201472:0:14110:0:(osc_cache.c:804:osc_extent_find()) ### extent: ffff8800aaab90b8 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1715205872.201483:0:14110:0:(vvp_io.c:1133:vvp_set_batch_dirty()) mapping ffff8800b23a2248, count 1, dirtied 1 00000080:00200000:1.0:1715205872.201490:0:14110:0:(vvp_io.c:1242:vvp_io_write_commit()) Committed 1 pages 1000 bytes, tot: 1000 00000080:00200000:1.0:1715205872.201496:0:14110:0:(vvp_io.c:1407:vvp_io_write_start()) f7.sanity-dom: write bytes 0, result: 1000 00000020:00010000:1.0:1715205872.201508:0:14110:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff8800b0acf5d8 (ffff8800b5968248/0) at cl_lock_release():233 00000020:00010000:1.0:1715205872.201510:0:14110:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b0acf5d8 (ffff8800b5968248/0) at cl_lock_cancel():150 00000020:00010000:1.0:1715205872.201512:0:14110:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800adc173b0 (ffff8800b59682d8/1) at cl_lock_cancel():150 00010000:00010000:1.0:1715205872.201516:0:14110:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1715205872.201522:0:14110:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000020:00010000:1.0:1715205872.201528:0:14110:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b0acf5d8 (ffff8800b5968248/0) at cl_lock_fini():85 00000020:00010000:1.0:1715205872.201530:0:14110:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800adc173b0 (ffff8800b5968248/1) at cl_lock_fini():85 00000080:00200000:1.0:1715205872.201534:0:14110:0:(vvp_io.c:533:vvp_io_advance()) advancing 1000 bytes 00000080:00200000:1.0:1715205872.201538:0:14110:0:(file.c:1916:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1715205872.201543:0:14110:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1715205872.201545:0:14110:0:(file.c:1950:ll_file_io_generic()) f7.sanity-dom: 2 io complete with rc: 0, result: 1000, restart: 0 00000080:00200000:1.0:1715205872.201549:0:14110:0:(file.c:1528:ll_merge_attr_nolock()) [0x200000402:0x1:0x0] updating i_size 1000 i_blocks 2 00000080:00200000:1.0:1715205872.201553:0:14110:0:(file.c:2030:ll_file_io_generic()) iot: 2, result: 1000 00000080:00200008:1.0:1715205872.201565:0:14110:0:(file.c:430:ll_file_release()) START file f7.sanity-dom:[0x200000402:0x1:0x0](ffff8800b23a20c8), flags 100001 00000002:00100000:1.0:1715205872.201580:0:14110:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012b1efb80 x1798523511134208/t4294967315(4294967315) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 744/824 e 0 to 0 dl 1715205888 ref 1 fl Complete:RPQU/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000020:00100000:1.0:1715205872.201592:0:14110:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a98fb800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1715205872.201595:0:14110:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b1eed80 x1798523511134336/t0(0) o35->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:23/10 lens 392/712 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715205872.201605:0:14110:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1eed80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134336:192.168.204.133@tcp:35:dd.0 00000100:00100000:1.0:1715205872.201634:0:14110:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851540 going to sleep for 11 seconds 00000100:00100000:3.0:1715205872.202338:0:14110:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1eed80 pname:cluuid:pid:xid:nid:opc:job dd:b074247a-b4e0-48d1-8030-d4461b52d5ca:14110:1798523511134336:192.168.204.133@tcp:35:dd.0 00000002:00100000:3.0:1715205872.202348:0:14110:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012b1efb80 x1798523511134208/t4294967315(4294967315) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 744/824 e 0 to 0 dl 1715205888 ref 1 fl Complete:RQU/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000080:00200000:0.0:1715205872.205394:0:14112:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205872.205406:0:14112:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205872.205432:0:14112:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205437:0:14112:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205442:0:14112:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14112 initiator: MDT0 00000100:00100000:0.0:1715205872.205450:0:14112:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f84c180 going to sleep for 0 seconds 00000100:00100000:0.0:1715205872.205455:0:14112:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job md5sum:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:14112:1798523511134400:192.168.204.133@tcp:101:md5sum.0 00010000:00010000:0.0:1715205872.205460:0:14112:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205464:0:14112:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205467:0:14112:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205470:0:14112:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205474:0:14112:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205477:0:14112:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa833c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205872.205479:0:14112:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205487:0:14112:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205491:0:14112:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205494:0:14112:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205872.205497:0:14112:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 14112 initiator: MDT0 00010000:00010000:0.0:1715205872.205500:0:14112:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 14112 initiator: MDT0 00000080:00020000:0.0:1715205872.205510:0:14112:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205872.209352:0:14115:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:0.0:1715205872.209363:0:14115:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205872.209388:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14115 initiator: MDT0 00010000:00010000:0.0:1715205872.209392:0:14115:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14115 initiator: MDT0 00010000:00010000:0.0:1715205872.209397:0:14115:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14115 initiator: MDT0 00000100:00100000:0.0:1715205872.209408:0:14115:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job md5sum:b074247a-b4e0-48d1-8030-d4461b52d5ca:14115:1798523511134464:192.168.204.133@tcp:101:md5sum.0 00000100:00100000:0.0:1715205872.209464:0:14115:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f84c180 going to sleep for 11 seconds 00000100:00100000:0.0:1715205872.210477:0:14115:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job md5sum:b074247a-b4e0-48d1-8030-d4461b52d5ca:14115:1798523511134464:192.168.204.133@tcp:101:md5sum.0 00010000:00010000:0.0:1715205872.210486:0:14115:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210501:0:14115:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210509:0:14115:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210517:0:14115:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210525:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210530:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210536:0:14115:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1715205872.210544:0:14115:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800adc33100 x1798523511134464/t0(0) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1715205888 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000002:00010000:0.0:1715205872.210553:0:14115:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210561:0:14115:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e104400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1715205872.210574:0:14115:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 11776 00000080:00010000:0.0:1715205872.210579:0:14115:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06df3 00000080:00010000:0.0:1715205872.210583:0:14115:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:0.0:1715205872.210586:0:14115:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06df3 from it ffff8800aab6bbb0 00010000:00010000:0.0:1715205872.210592:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.210598:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1715205872.210612:0:14115:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8), inode mode 41ed mask 1 00000080:00200000:0.0:1715205872.210617:0:14115:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=f7.sanity-dom, flags=257 00000080:00200000:0.0:1715205872.210621:0:14115:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8800b23a20c8), inode mode 81a4 mask 44 00000080:00200008:0.0:1715205872.210624:0:14115:0:(file.c:871:ll_file_open()) START file f7.sanity-dom:[0x200000402:0x1:0x0](ffff8800b23a20c8), flags 100000 00000002:00010000:0.0:1715205872.210634:0:14115:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240100001 00010000:00010000:0.0:1715205872.210651:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 14115 initiator: MDT0 00010000:00010000:0.0:1715205872.210656:0:14115:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 14115 initiator: MDT0 00000020:00100000:0.0:1715205872.210662:0:14115:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a98fb800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1715205872.210666:0:14115:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800adc33100 x1798523511134592/t0(0) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 736/66408 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1715205872.210672:0:14115:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 14115 initiator: MDT0 00000100:00100000:0.0:1715205872.210680:0:14115:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job md5sum:b074247a-b4e0-48d1-8030-d4461b52d5ca:14115:1798523511134592:192.168.204.133@tcp:101:md5sum.0 00000100:00100000:0.0:1715205872.210742:0:14115:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f84c180 going to sleep for 11 seconds 00000100:00100000:0.0:1715205872.211519:0:14115:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job md5sum:b074247a-b4e0-48d1-8030-d4461b52d5ca:14115:1798523511134592:192.168.204.133@tcp:101:md5sum.0 00010000:00010000:0.0:1715205872.211528:0:14115:0:(ldlm_request.c:741:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 4/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.211541:0:14115:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 4/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.211546:0:14115:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205872.211551:0:14115:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1715205872.211559:0:14115:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8800adc33100 x1798523511134592/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205888 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000002:00100000:0.0:1715205872.211567:0:14115:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800adc33100 x1798523511134592/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205888 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000002:00010000:0.0:1715205872.211574:0:14115:0:(mdc_locks.c:942:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 216 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1715205872.211580:0:14115:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211585:0:14115:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff88012e104400 type 13 mode 16 res 8589935618/1 (0 0) 00000080:00200000:0.0:1715205872.211609:0:14115:0:(file.c:6276:ll_layout_conf()) [0x200000402:0x1:0x0]: layout version change: 2 -> 2 00000080:00010000:0.0:1715205872.211612:0:14115:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1:0x0](ffff8800b23a20c8) for lock 0x361984fab9c06dfa 00000080:00010000:0.0:1715205872.211615:0:14115:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06dfa from it ffff8800aab6bbc0 00010000:00010000:0.0:1715205872.211617:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211622:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00000002:00100000:0.0:1715205872.211638:0:14115:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800adc33100 x1798523511134592/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205888 ref 2 fl Complete:RPQU/204/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000080:00200008:0.0:1715205872.211697:0:14115:0:(file.c:5701:ll_getattr_dentry()) START file f7.sanity-dom:[0x200000402:0x1:0x0](ffff8800b23a20c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205872.211700:0:14115:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8800b23a20c8),name=f7.sanity-dom 00000002:00010000:0.0:1715205872.211707:0:14115:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000402:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205872.211712:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211718:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00010000:0.0:1715205872.211723:0:14115:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x1:0x0](ffff8800b23a20c8) 00000080:00010000:0.0:1715205872.211725:0:14115:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000402:0x1:0x0](ffff8800b23a20c8) for lock 0x361984fab9c06de5 00000080:00010000:0.0:1715205872.211728:0:14115:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06de5 from it ffff8800aab6bcd8 00010000:00010000:0.0:1715205872.211730:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211734:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205872.211745:0:14115:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1715205872.211752:0:14115:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x1:0x0] 00000002:00010000:0.0:1715205872.211783:0:14115:0:(lustre_osc.h:184:osc_enq2ldlm_flags()) flags: a 00000002:00010000:0.0:1715205872.211790:0:14115:0:(mdc_dev.c:1003:mdc_lock_init()) ### lock ffff8800b0a72230, mdc lock ffff8800b5b32000, flags 400001002 00010000:00010000:0.0:1715205872.211799:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211810:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211834:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 6/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211839:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205872.211850:0:14115:0:(file.c:1528:ll_merge_attr_nolock()) [0x200000402:0x1:0x0] updating i_size 1000 i_blocks 2 00000020:00010000:0.0:1715205872.211852:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff8800aaa756d0 (ffff8800b6d28128/0) at cl_lock_release():233 00000020:00010000:0.0:1715205872.211855:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800aaa756d0 (ffff8800b6d28128/0) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.211857:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b0a72230 (ffff8800b6d281b8/1) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.211859:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800aaa756d0 (ffff8800b6d28128/0) at cl_lock_fini():85 00000020:00010000:0.0:1715205872.211861:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b0a72230 (ffff8800b6d28128/1) at cl_lock_fini():85 00000080:00200000:0.0:1715205872.211867:0:14115:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1715205872.211880:0:14115:0:(file.c:2203:ll_file_read_iter()) START file f7.sanity-dom:[0x200000402:0x1:0x0], ppos: 0, count: 32768 00000080:00200000:0.0:1715205872.211884:0:14115:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00000080:00200000:0.0:1715205872.211887:0:14115:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1715205872.211890:0:14115:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1715205872.211892:0:14115:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x1:0x0] 00000002:00010000:0.0:1715205872.211903:0:14115:0:(lustre_osc.h:184:osc_enq2ldlm_flags()) flags: a 00000002:00010000:0.0:1715205872.211905:0:14115:0:(mdc_dev.c:1003:mdc_lock_init()) ### lock ffff8800b0a72230, mdc lock ffff8800b5b32000, flags 400001002 00010000:00010000:0.0:1715205872.211910:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211915:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211925:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 6/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211931:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205872.211939:0:14115:0:(file.c:1528:ll_merge_attr_nolock()) [0x200000402:0x1:0x0] updating i_size 1000 i_blocks 2 00000020:00010000:0.0:1715205872.211942:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff8800aaa75918 (ffff8800b6d281b8/0) at cl_lock_release():233 00000020:00010000:0.0:1715205872.211943:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800aaa75918 (ffff8800b6d281b8/0) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.211945:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b0a72230 (ffff8800b6d28248/1) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.211947:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800aaa75918 (ffff8800b6d281b8/0) at cl_lock_fini():85 00000020:00010000:0.0:1715205872.211949:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b0a72230 (ffff8800b6d281b8/1) at cl_lock_fini():85 00000080:00200000:0.0:1715205872.211953:0:14115:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1715205872.211956:0:14115:0:(file.c:2168:file_read_confine_iter()) f7.sanity-dom: read [0, 32768] over eof, kms 1000, file_size 1000. 00000080:00200008:0.0:1715205872.211967:0:14115:0:(file.c:2203:ll_file_read_iter()) START file f7.sanity-dom:[0x200000402:0x1:0x0], ppos: 1000, count: 24576 00000080:00200000:0.0:1715205872.211969:0:14115:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00000080:00200000:0.0:1715205872.211974:0:14115:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1715205872.211976:0:14115:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00000001:00010000:0.0:1715205872.211979:0:14115:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x1:0x0] 00000002:00010000:0.0:1715205872.211983:0:14115:0:(lustre_osc.h:184:osc_enq2ldlm_flags()) flags: a 00000002:00010000:0.0:1715205872.211985:0:14115:0:(mdc_dev.c:1003:mdc_lock_init()) ### lock ffff8800b0a72230, mdc lock ffff8800b5b32000, flags 400001002 00010000:00010000:0.0:1715205872.211991:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.211997:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212011:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 6/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212017:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205872.212025:0:14115:0:(file.c:1528:ll_merge_attr_nolock()) [0x200000402:0x1:0x0] updating i_size 1000 i_blocks 2 00000020:00010000:0.0:1715205872.212027:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff8800aaa75918 (ffff8800b6d281b8/0) at cl_lock_release():233 00000020:00010000:0.0:1715205872.212029:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800aaa75918 (ffff8800b6d281b8/0) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.212031:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b0a72230 (ffff8800b6d28248/1) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.212033:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800aaa75918 (ffff8800b6d281b8/0) at cl_lock_fini():85 00000020:00010000:0.0:1715205872.212035:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b0a72230 (ffff8800b6d281b8/1) at cl_lock_fini():85 00000080:00200000:0.0:1715205872.212039:0:14115:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1715205872.212042:0:14115:0:(file.c:2168:file_read_confine_iter()) f7.sanity-dom: read [1000, 25576] over eof, kms 1000, file_size 1000. 00000080:00200000:0.0:1715205872.212046:0:14115:0:(file.c:1812:ll_file_io_generic()) f7.sanity-dom: read ppos: 1000, bytes: 24576 00000080:00200000:0.0:1715205872.212049:0:14115:0:(file.c:1599:ll_io_set_mirror()) f7.sanity-dom: desiginated mirror: 0 00000020:00200000:0.0:1715205872.212053:0:14115:0:(cl_io.c:195:cl_io_rw_init()) header@ffff88012f84e4b0[0x4, 2, [0x200000402:0x1:0x0] hash] 00000020:00200000:0.0:1715205872.212055:0:14115:0:(cl_io.c:195:cl_io_rw_init()) io range: 1 [1000, 25576) 0 0 00000080:00200000:0.0:1715205872.212057:0:14115:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00020000:00200000:0.0:1715205872.212064:0:14115:0:(lov_io.c:1039:lov_io_rw_iter_init()) stripe: 1000 chunk: [1000, 25576) 25576, 24576 00020000:00200000:0.0:1715205872.212067:0:14115:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1715205872.212074:0:14115:0:(vvp_io.c:215:vvp_io_one_lock_index()) lock: 0 [0, 6] 00000002:00010000:0.0:1715205872.212079:0:14115:0:(lustre_osc.h:184:osc_enq2ldlm_flags()) flags: 0 00000002:00010000:0.0:1715205872.212081:0:14115:0:(mdc_dev.c:1003:mdc_lock_init()) ### lock ffff8800b0a72230, mdc lock ffff8800b5b32000, flags 0 00010000:00010000:0.0:1715205872.212086:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212092:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212102:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 7/1,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212108:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 7/1,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212113:0:14115:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 6/1,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205872.212119:0:14115:0:(vvp_io.c:840:vvp_io_read_start()) f7.sanity-dom: read [1000, 25576) 00000001:00010000:0.0:1715205872.212125:0:14115:0:(glimpse.c:90:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x1:0x0] 00000002:00010000:0.0:1715205872.212128:0:14115:0:(lustre_osc.h:184:osc_enq2ldlm_flags()) flags: a 00000002:00010000:0.0:1715205872.212130:0:14115:0:(mdc_dev.c:1003:mdc_lock_init()) ### lock ffff8800b0a722b0, mdc lock ffff8800b5b32130, flags 400001002 00010000:00010000:0.0:1715205872.212133:0:14115:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/1,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212139:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/1,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212145:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 8/1,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212150:0:14115:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 7/1,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205872.212156:0:14115:0:(file.c:1528:ll_merge_attr_nolock()) [0x200000402:0x1:0x0] updating i_size 1000 i_blocks 2 00000020:00010000:0.0:1715205872.212158:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff8800aaa756d0 (ffff8800b6d28128/0) at cl_lock_release():233 00000020:00010000:0.0:1715205872.212159:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800aaa756d0 (ffff8800b6d28128/0) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.212161:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b0a722b0 (ffff8800b6d281b8/1) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.212166:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800aaa756d0 (ffff8800b6d28128/0) at cl_lock_fini():85 00000020:00010000:0.0:1715205872.212168:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b0a722b0 (ffff8800b6d28128/1) at cl_lock_fini():85 00000080:00200000:0.0:1715205872.212171:0:14115:0:(vvp_io.c:899:vvp_io_read_start()) count:24576 iocb pos:1000 00000020:00010000:0.0:1715205872.212177:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) release lock: ffff8800ac2376c8 (ffff8800b6d28128/0) at cl_lock_release():233 00000020:00010000:0.0:1715205872.212179:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800ac2376c8 (ffff8800b6d28128/0) at cl_lock_cancel():150 00000020:00010000:0.0:1715205872.212181:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) cancel lock: ffff8800b0a72230 (ffff8800b6d281b8/1) at cl_lock_cancel():150 00010000:00010000:0.0:1715205872.212184:0:14115:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 5/1,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x810020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205872.212189:0:14115:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000020:00010000:0.0:1715205872.212196:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800ac2376c8 (ffff8800b6d28128/0) at cl_lock_fini():85 00000020:00010000:0.0:1715205872.212198:0:14115:0:(cl_lock.c:53:__cl_lock_trace()) destroy lock: ffff8800b0a72230 (ffff8800b6d28128/1) at cl_lock_fini():85 00000080:00200000:0.0:1715205872.212201:0:14115:0:(vvp_io.c:533:vvp_io_advance()) advancing 0 bytes 00000080:00200000:0.0:1715205872.212205:0:14115:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1715205872.212208:0:14115:0:(file.c:1950:ll_file_io_generic()) f7.sanity-dom: 1 io complete with rc: 0, result: 0, restart: 0 00000080:00200000:0.0:1715205872.212210:0:14115:0:(file.c:2030:ll_file_io_generic()) iot: 1, result: 0 00000080:00200008:0.0:1715205872.212234:0:14115:0:(file.c:4905:ll_file_seek()) START file f7.sanity-dom:[0x200000402:0x1:0x0], offset: 0, type: SEEK_CUR 00000080:00200008:0.0:1715205872.212239:0:14115:0:(file.c:4937:ll_file_seek()) COMPLETED file f7.sanity-dom:[0x200000402:0x1:0x0], offset: 0, type: SEEK_CUR, rc = 1000 00000080:00200008:0.0:1715205872.212251:0:14115:0:(file.c:430:ll_file_release()) START file f7.sanity-dom:[0x200000402:0x1:0x0](ffff8800b23a20c8), flags 100000 00010000:00010000:0.0:1715205872.212260:0:14115:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00000001:02000400:1.0:1715205872.522827:0:14247:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-dom test_7: @@@@@@ FAIL: Client reads stale page 00010000:00010000:0.0:1715205872.683886:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 385 lines, 385 kept, 0 dropped, 0 bad.